-- Logs begin at Wed 2022-10-12 11:50:07 UTC, end at Wed 2022-10-12 12:58:14 UTC. -- Oct 12 12:21:48.815879 dv-cinder-846146-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 12 12:21:48.824141 dv-cinder-846146-8-smb devstack@keystone.service[81511]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 12:21:48 2022] *** Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: nodename: dv-cinder-846146-8-smb Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: machine: x86_64 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: clock source: unix Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: pcre jit disabled Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: detected number of CPU cores: 4 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: current working directory: / Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: detected binary path: /usr/bin/uwsgi-core Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: your processes number limit is 47680 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: your memory page size is 4096 bytes Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: detected max file descriptor number: 2048 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: lock engine: pthread robust mutexes Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: thunder lock: enabled Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 12 12:21:48.828658 dv-cinder-846146-8-smb devstack@keystone.service[81511]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 12:21:48.867058 dv-cinder-846146-8-smb devstack@keystone.service[81511]: Python main interpreter initialized at 0x56220ad999c0 Oct 12 12:21:48.867058 dv-cinder-846146-8-smb devstack@keystone.service[81511]: python threads support enabled Oct 12 12:21:48.867058 dv-cinder-846146-8-smb devstack@keystone.service[81511]: your server socket listen backlog is limited to 100 connections Oct 12 12:21:48.867058 dv-cinder-846146-8-smb devstack@keystone.service[81511]: your mercy for graceful operations on workers is 90 seconds Oct 12 12:21:48.867432 dv-cinder-846146-8-smb devstack@keystone.service[81511]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 12:21:48.867509 dv-cinder-846146-8-smb devstack@keystone.service[81511]: *** Operational MODE: preforking *** Oct 12 12:21:48.867767 dv-cinder-846146-8-smb devstack@keystone.service[81511]: *** uWSGI is running in multiple interpreter mode *** Oct 12 12:21:48.867767 dv-cinder-846146-8-smb devstack@keystone.service[81511]: spawned uWSGI master process (pid: 81511) Oct 12 12:21:48.867974 dv-cinder-846146-8-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 12 12:21:48.869474 dv-cinder-846146-8-smb devstack@keystone.service[81511]: spawned uWSGI worker 1 (pid: 81526, cores: 1) Oct 12 12:21:48.869474 dv-cinder-846146-8-smb devstack@keystone.service[81511]: spawned uWSGI worker 2 (pid: 81527, cores: 1) Oct 12 12:21:48.869474 dv-cinder-846146-8-smb devstack@keystone.service[81511]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 12:21:53.228305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:21:53.228305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: from cryptography.utils import int_from_bytes Oct 12 12:21:53.229094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:21:53.229094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: from cryptography.utils import int_from_bytes Oct 12 12:21:53.229605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:21:53.229605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: from cryptography.utils import int_from_bytes Oct 12 12:21:53.229723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:21:53.229723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: from cryptography.utils import int_from_bytes Oct 12 12:21:53.279106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:21:53.279280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:21:53.279360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:21:53.279449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:21:53.279528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] command line args: [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:21:53.279599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] command line args: [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:21:53.279727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:21:53.279870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:21:53.279949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ================================================================================ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:21:53.280055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ================================================================================ {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:21:53.280135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] admin_token = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] admin_token = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] config_dir = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] config_dir = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] config_source = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] config_source = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.280998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] debug = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] debug = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.281986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_config_append = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_config_append = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.282990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_dir = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_dir = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_file = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.283950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.284911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.285838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.286978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] publish_errors = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.50/identity {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] publish_errors = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.287962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] standard_threads = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] standard_threads = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.288974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] use_journal = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] use_json = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] use_journal = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.289931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] use_stderr = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] use_json = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] use_syslog = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] use_stderr = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] use_syslog = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290633 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:21:53.290757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.290873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.290994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.291970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.292910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.293977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.294916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.295961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.296784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.297936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.298998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.299986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.300924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.301054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.305672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.305794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.305909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.306937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.307964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.308964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.309973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.310949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.311996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.312917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.313939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.314938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315033 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.315926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.316965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.317977 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.external = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.external = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.318996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.password = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] auth.token = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.password = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] auth.token = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.319993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.320653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.321937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.322949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.323890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.324916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.325837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327236 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.327973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.328779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334637 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.334942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.335970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.336042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.336122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.336195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.336267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.336338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.337948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.338982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.339995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.340974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341306 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.341875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.342980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.343928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.344956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.345934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.346804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.347995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.348980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] role.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] role.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] role.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] role.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.349947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.350889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.351917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.352759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.353847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.354973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.355931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.356968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.357939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.358905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.359859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.360832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.361852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.connection = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.362962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.363968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.364906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81527) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:21:53.365976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.365976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.366199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:21:53.366360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:21:53.395448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.395677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.395829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.395913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.396067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.396300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.404791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.405274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.432556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.432783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.433008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.433271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.486711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.486948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.535375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.535606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.536131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.536372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.691980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.692108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.692189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.692323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.715750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.715940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.716928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.717052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.717151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.717295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.728124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.728458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.740714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.740902 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.741882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.742004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81527) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.742085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.742220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81526) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 12 12:21:53.759668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.759878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:21:53.760135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.760225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.760352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:21:53.760436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:21:53.760670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.760761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.760884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 12 12:21:53.760965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.761978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.770984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.771264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.771540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.771622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.771827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.771910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.772101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.772389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.778791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.779430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.781696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.781982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.782265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.782359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.782549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.782631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.782835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.782916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.783999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.784184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.784264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.784454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.784543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.784757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.785035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.807422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.808067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.808880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.809187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.809563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.809853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.813827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.814112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.814396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.814477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.814766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.815053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.821548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.821837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.822211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.822504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.827429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.827730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.828313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.828876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.829879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.830154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.844798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.845079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.845586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.845871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.848911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.849744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.852660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.852956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.853522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.853826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.857168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.858041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.860294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.861239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.863526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.863829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864685 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.864971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.865054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.865345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.865637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.865924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.881149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.881436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.881704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.881970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.882210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.882505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.882782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.883054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.888753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.889936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.890318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.891482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.891832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.892118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.893021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.893395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.894793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.895081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.895366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.895646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.896046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.896129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.896338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.896626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.896917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.897347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.907119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.907412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.907692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.907971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.908350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.908493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.908632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.908784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.908912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.909072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.909388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.909772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.910057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.910343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.924618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.926173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.927521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.929089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.931008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.932455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.932626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.933949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.934107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.934232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.934646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.935568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.935867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.936275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.940907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.942387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.942913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.944376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.945516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.945939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.946231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.946511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.947334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.947733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.948028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.948317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.954250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.954540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.954825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.956110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.956406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.956690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.961672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81527) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.961960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.962246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.962525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.962813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.963087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.963364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.963597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81526) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 12 12:21:53.963686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.963885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.963966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.964820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81527) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.965881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.966170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.966540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.966809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.967079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.967345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81526) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 12 12:21:53.999943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56220ad999c0 pid: 81527 (default app) Oct 12 12:21:54.002175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56220ad999c0 pid: 81526 (default app) Oct 12 12:21:54.003199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd3a6-6d02-4ae8-a430-e19f5543fe9d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:21:54.003484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd3a6-6d02-4ae8-a430-e19f5543fe9d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:21:54.003756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835bd3a6-6d02-4ae8-a430-e19f5543fe9d None None] PATH_INFO: `/v3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:21:54.007878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 791 bytes} [Wed Oct 12 12:21:53 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:01.687507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.688025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.688107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.692747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1/2] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:01 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:01.698713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:01.699156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:01.699299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:01.771881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: INFO dbcounter [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] Registered counter for database keystone Oct 12 12:22:01.790676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG oslo_db.sqlalchemy.engines [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81527) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:22:01.796699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writer thread running {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:22:01.973530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG passlib.handlers.bcrypt [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81527) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 12:22:01.973845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG passlib.handlers.bcrypt [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81527) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 12:22:02.031867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:02.033767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:02.160142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:01 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:22:02.608333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:02.678717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: INFO dbcounter [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] Registered counter for database keystone Oct 12 12:22:02.700245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG oslo_db.sqlalchemy.engines [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:22:02.706466 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writer thread running {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:22:02.827953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf44cbf-703c-4272-b719-2f88563bd9f5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:02.832205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:02.832838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:02.833119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:02.833416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:02.842016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:02.893413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING keystone.common.rbac_enforcer.enforcer [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 12:22:02.893700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd8322-baa4-47bc-96c8-58bde7f9f42e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:02.903415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 2/4] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Oct 12 12:22:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:22:02.909320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:02.925946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeedde9-b5f2-4db9-bd62-ebb9afd7135d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:02.930459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:02.931553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:02.931840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:02.932118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] PATH_INFO: `/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:02.933713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4cf6bda1a6094b07a02029e1fb53aa49)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:02.986939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 12 12:22:02.987292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021145c-b690-41f9-99eb-cb146bcb18b8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:02.991765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 3/5] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:02 2022] GET /identity/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:05.100572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d92889-f230-4004-8e28-9f088ff6e695 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:05.101117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d92889-f230-4004-8e28-9f088ff6e695 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:05.101117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d92889-f230-4004-8e28-9f088ff6e695 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:05.105237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 3/6] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:05.110535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:05.110893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:05.111088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:05.130891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:05.132404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:05.140792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:22:05.406185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d92889-f230-4004-8e28-9f088ff6e695 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:05.418654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d92889-f230-4004-8e28-9f088ff6e695 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:05.422834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:05.423427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:05.423706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:05.423976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:05.432233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:05.434023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4addd91e-862e-47f4-8ef9-cdb4f61400c8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:05.442830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1324 bytes} [Wed Oct 12 12:22:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:22:05.448045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:05.457186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57ea7b-9704-43bb-85e9-b7f4adbecc74 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:05.462270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:05.462904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:05.463192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:05.463469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] PATH_INFO: `/v3/users/02af815b1eff42b89905491a18971077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:05.464795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=02af815b1eff42b89905491a18971077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:05.466683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f034b-30a0-4d36-8fbd-f06f9625e1c8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:05.468216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 5/9] 10.222.0.50 () {56 vars in 1198 bytes} [Wed Oct 12 12:22:05 2022] GET /identity/v3/users/02af815b1eff42b89905491a18971077 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:07.644132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c439fb-7125-4c39-8b6d-3ab95dc544a9 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.644668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c439fb-7125-4c39-8b6d-3ab95dc544a9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.644668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c439fb-7125-4c39-8b6d-3ab95dc544a9 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.646039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 5/10] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:07.651201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.651657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.651905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.670304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:07.671505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:07.672678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afe6f-d7af-45dd-a785-f2bbc9d4cef0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.672966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afe6f-d7af-45dd-a785-f2bbc9d4cef0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.673280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32afe6f-d7af-45dd-a785-f2bbc9d4cef0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.674598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 6/11] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:07.679619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:07.680927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:07.680927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:07.722260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG passlib.handlers.bcrypt [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81526) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 12 12:22:07.722653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG passlib.handlers.bcrypt [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81526) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 12 12:22:07.755012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:07.771744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:07.773349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:07.872801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:08.024676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.048852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.128724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11c794-3433-4681-a4da-5cbe0c52d0ad None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.135051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.163562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.164210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.164514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.164792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.176135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:08.184584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:08.185495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:08.186260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 7/14] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:08.191503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.237839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3beb7-9d31-474b-b9c8-dbf21152f083 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.240344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.271426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.276584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.277472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.277762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.278040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.279020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.280462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.289584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b9d01-78a3-4e12-b177-0cddbb850742 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.324009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.324624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.324908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.325211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.325883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:08.326187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.327591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.333345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.sql.core [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:22:08.333345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:22:08.333345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [parameters: {'id': 'dcf12186adf44770a123b95f811c46c1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:22:08.333345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81526) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:22:08.339809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 8/15] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:08.345421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:22:08.352325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result.read() Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:22:08.353082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application yield resource Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise self.value Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application session.commit() Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:22:08.354141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:22:08.355597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:22:08.356602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result.read() Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:22:08.358098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [parameters: {'id': 'dcf12186adf44770a123b95f811c46c1', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:22:08.359552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:08.360416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 8/16] 10.222.0.50 () {60 vars in 1137 bytes} [Wed Oct 12 12:22:08 2022] POST /identity/v3/domains => generated 190 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:08.361416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.448760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c85717-0e4f-43bf-a311-c3199b61b0d6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.462242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81b8f9-9812-4c40-b6be-d1c4cc30fd70 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.481709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.482334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.482612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.482885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] PATH_INFO: `/v3/users/02af815b1eff42b89905491a18971077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.484011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] RBAC: Authorizing `identity:get_user(user_id=02af815b1eff42b89905491a18971077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.485513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.487238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 9/17] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/users/02af815b1eff42b89905491a18971077 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:08.492974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.499748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.500612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.500901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.501208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.506784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.519666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.521172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:22:08.536868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:08.537743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:22:08.538799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:22:08.538799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:22:08.538799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:08.538799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 9/18] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:08.543675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.565632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.591339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b77a-b654-4d61-acc1-944439469cbf None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.625089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.625760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.626049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.626325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.627447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.628916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.630519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 10/19] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:08.636717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:08.646926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfa455-f7fd-4b11-a251-a0238be2eb29 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.680696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.681341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.681627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.681898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.682541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:08.682840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.684220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfeef39-3763-402a-b5e8-0bfecfcfdc66 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.701855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 10/20] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:08.720078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:08.740082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c74c45-56c4-46d7-bc8b-719c1c3e0119 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:08.777264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:08.777955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:08.778234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:08.778508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] PATH_INFO: `/v3/domains/default/users/02af815b1eff42b89905491a18971077/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:08.780494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=02af815b1eff42b89905491a18971077, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:08.782028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40097eae-2aa3-4181-b86d-187228a312d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:08.959212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 11/21] 10.222.0.50 () {58 vars in 1361 bytes} [Wed Oct 12 12:22:08 2022] PUT /identity/v3/domains/default/users/02af815b1eff42b89905491a18971077/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:22:11.440675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cf7f-7a94-4677-a5ec-45699c81e915 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.441791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cf7f-7a94-4677-a5ec-45699c81e915 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.442287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0cf7f-7a94-4677-a5ec-45699c81e915 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.444569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 11/22] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:11.450465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8057fc-72eb-4b50-b089-6d48cb01f20e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.451408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8057fc-72eb-4b50-b089-6d48cb01f20e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.451881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8057fc-72eb-4b50-b089-6d48cb01f20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.486510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3d8057fc-72eb-4b50-b089-6d48cb01f20e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:11.488439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3d8057fc-72eb-4b50-b089-6d48cb01f20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:11.571530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 12/23] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:11.590873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d324b-13eb-4b5f-b364-8435879f21aa None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.591489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d324b-13eb-4b5f-b364-8435879f21aa None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.591976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d324b-13eb-4b5f-b364-8435879f21aa None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.593540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 12/24] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:11.599340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa306c-d0ff-4ea4-a667-f87dc74ce29a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.599991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa306c-d0ff-4ea4-a667-f87dc74ce29a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.600483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa306c-d0ff-4ea4-a667-f87dc74ce29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.630481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-88aa306c-d0ff-4ea4-a667-f87dc74ce29a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:11.632076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-88aa306c-d0ff-4ea4-a667-f87dc74ce29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:11.713158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:11.717363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 13/25] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:11.814018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17f56-366e-41a9-b87e-f9c1baa193e6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.814749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17f56-366e-41a9-b87e-f9c1baa193e6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.815221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d17f56-366e-41a9-b87e-f9c1baa193e6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.816872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 13/26] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:11.823835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29258-217b-4f65-8a96-2e26d6dba757 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:11.824447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29258-217b-4f65-8a96-2e26d6dba757 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:11.824983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c29258-217b-4f65-8a96-2e26d6dba757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:11.854256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e1c29258-217b-4f65-8a96-2e26d6dba757 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:11.855939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e1c29258-217b-4f65-8a96-2e26d6dba757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:11.922697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17f56-366e-41a9-b87e-f9c1baa193e6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:11.955580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 14/27] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:12.027972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0430d8-a20f-4510-a588-37b43a5e4e01 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.028292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0430d8-a20f-4510-a588-37b43a5e4e01 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.028549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0430d8-a20f-4510-a588-37b43a5e4e01 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.032866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 15/28] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:12.038381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0430d8-a20f-4510-a588-37b43a5e4e01 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.051002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:12.074349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d17f56-366e-41a9-b87e-f9c1baa193e6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.126823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.127373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.127661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.127940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.128625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:12.130047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:12.179490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0430d8-a20f-4510-a588-37b43a5e4e01 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.209535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:12.216097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.216738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.217020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.217324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.228220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:12.232335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1a90a95b-61bf-4cf4-be59-f35e5d50784c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:22:12.246450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:12.247343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:22:12.248835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:22:12.248835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:22:12.248835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:12.248835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 16/29] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:12.248835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.249236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.250279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.268328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:12.269667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:12.354394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 17/30] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:12.355125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.459051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55413fd5-022f-40be-8f14-d070b507eefc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.474013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 14/31] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Oct 12 12:22:11 2022] POST /identity/v3/roles => generated 219 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:12.481513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:12.481813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.506264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.506883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.507160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.507431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.508632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:12.508992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:12.510506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:12.537151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 18/32] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:12.537151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.664889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eddf1c-ea5c-4476-9884-f8807b4a4abe None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.684536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae55b4e-fb75-4ac2-a6cf-ec5ba1c401b5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.705969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.707036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.707531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.708028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.718789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:12.721909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.722535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.722819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.723096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.723834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:12.724574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:12.725260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:12.732687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:12.736415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:12.737304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 15/33] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:12.741098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.856350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d4b5b-e134-43d8-a684-8ede291fe4ec None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:12.892226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:12.892911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:12.893241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:12.893523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:12.894205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:12.894547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:12.896087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:12.909100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 16/34] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:12.909836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.915399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 19/35] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:22:12 2022] POST /identity/v3/projects => generated 301 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:22:12.916323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:12.967787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.000865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.054750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbeb839-791f-44b5-9373-58ee1f111ca2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.083566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eec471-8ac5-4979-a888-a1d0e7cfbefd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.098103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.098737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.099092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.099433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.100109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.101673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcbda9-2c48-4c1d-81d3-a640a968f320 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.122835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.123829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.123829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.124044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] PATH_INFO: `/v3/users/02af815b1eff42b89905491a18971077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.125241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] RBAC: Authorizing `identity:get_user(user_id=02af815b1eff42b89905491a18971077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.126726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5582199-fb40-491a-b183-b471858dcce0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.128328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 20/36] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:12 2022] GET /identity/v3/users/02af815b1eff42b89905491a18971077 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:13.129490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86024c-63ae-4476-aeb6-235bd786827b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.129839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86024c-63ae-4476-aeb6-235bd786827b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.130122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86024c-63ae-4476-aeb6-235bd786827b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.131327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 21/37] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:13.132368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670641c6-7a7e-450d-9db7-51800ea38660 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.132687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670641c6-7a7e-450d-9db7-51800ea38660 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.132938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670641c6-7a7e-450d-9db7-51800ea38660 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.134770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 22/38] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:13.135482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670641c6-7a7e-450d-9db7-51800ea38660 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:13.182614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 17/39] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Oct 12 12:22:12 2022] POST /identity/v3/roles => generated 225 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:13.184222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35892a-21f8-4c09-8bf5-2e3c42571b0c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35892a-21f8-4c09-8bf5-2e3c42571b0c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.184794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35892a-21f8-4c09-8bf5-2e3c42571b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.206948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8b35892a-21f8-4c09-8bf5-2e3c42571b0c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:13.208622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8b35892a-21f8-4c09-8bf5-2e3c42571b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:13.289598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 18/40] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:13.290614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.290912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.291188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.315348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:13.317040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:13.366438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.379706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670641c6-7a7e-450d-9db7-51800ea38660 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.385037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.409705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 19/41] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:13.424435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.425165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.426303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.426303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.427251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.428728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.431113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 23/42] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:13.437007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:13.546774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5945c5e-d234-482f-9e7c-c4f1763c8764 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.565774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:13.585211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.585838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.586121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.586427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.587163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.domain.id=default, user.id=02af815b1eff42b89905491a18971077) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:13.587479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.589088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.601254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 20/43] 10.222.0.50 () {56 vars in 1322 bytes} [Wed Oct 12 12:22:13 2022] GET /identity/v3/role_assignments?user.id=02af815b1eff42b89905491a18971077&scope.domain.id=default&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 530 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:13.679818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86def1a-6b41-4b17-901c-09b0d4da1ce5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.690091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:13.721087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.721751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.722040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.722321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.723027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.724476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.743804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.800427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22439-db6a-4046-9053-bd9340589b47 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:13.833816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 24/44] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Oct 12 12:22:13 2022] POST /identity/v3/roles => generated 223 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:22:13.838360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:13.839054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:13.839354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:13.839644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:13.840987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:13.842525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9a08e-f7bf-4529-a048-089fc2ff86aa None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:13.844252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 21/45] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:13.850257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:13.875400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:13.976652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f09d96-f8c1-400f-970b-03d6c8d2667a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:14.015519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:14.016243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:14.017160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:14.017160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:14.017624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:14.019093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df970de-2134-4564-92d5-a61deba8cbbb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:14.109417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 25/46] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:22:13 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:22:16.243026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d493-4493-4297-85a5-6fa29782ab96 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:16.243569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d493-4493-4297-85a5-6fa29782ab96 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:16.243569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0d493-4493-4297-85a5-6fa29782ab96 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:16.244929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 22/47] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:16.250025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:16.250404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:16.250583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:16.268179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:16.269410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:16.334812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 26/48] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:16.607887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d493-4493-4297-85a5-6fa29782ab96 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:16.706692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0d493-4493-4297-85a5-6fa29782ab96 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:16.720672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:16.739689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:16.740373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:16.740657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:16.740932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:16.742073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:16.744058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cf0e2-d291-459e-bb61-90fe0c4bebb0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:16.745616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 23/49] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:16.751037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:16.753273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:16.849318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffa210-42e3-4d4e-a5db-e0886b5047f5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:16.882104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:16.882653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:16.882937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:16.883766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:16.884423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:16.885889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc65c26-df4d-4fe5-949c-b1440051b528 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:16.953585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 27/50] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Oct 12 12:22:16 2022] POST /identity/v3/projects => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:19.074524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84047-ecd9-4d6c-a77d-0fd50ab9a5ee None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:19.075069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84047-ecd9-4d6c-a77d-0fd50ab9a5ee None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:19.075069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c84047-ecd9-4d6c-a77d-0fd50ab9a5ee None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:19.076411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 24/51] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:19.081491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:19.081887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:19.082045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:19.100259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:19.101474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:19.149100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:19.166139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 28/52] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:19.436704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84047-ecd9-4d6c-a77d-0fd50ab9a5ee None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:19.537183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c84047-ecd9-4d6c-a77d-0fd50ab9a5ee None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:19.569785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:19.570414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:19.571209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:19.571482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:19.572591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:19.574066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d584560-dbb2-4cf3-a64c-883247ec45b8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:19.575588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 25/53] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:19.580909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:19.675970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a8a56-18ad-48ea-95f9-47adbc8c14b1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:19.708827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:19.709446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:19.709728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:19.710000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:19.710640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:19.712617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c1119-0743-46e4-a09f-b2a9c138d536 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:19.835930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 29/54] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:19 2022] POST /identity/v3/users => generated 275 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:22.909558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e174-8ab4-45b0-81a6-99c18d846c2f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:22.910090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e174-8ab4-45b0-81a6-99c18d846c2f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:22.910163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e174-8ab4-45b0-81a6-99c18d846c2f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:22.911807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 26/55] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:22.917217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f9ec-5824-4e70-a4ab-3c4056e71738 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:22.917615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f9ec-5824-4e70-a4ab-3c4056e71738 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:22.917791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4f9ec-5824-4e70-a4ab-3c4056e71738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:22.941364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-deb4f9ec-5824-4e70-a4ab-3c4056e71738 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:22.942861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-deb4f9ec-5824-4e70-a4ab-3c4056e71738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:22.990274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:23.033242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 30/56] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:23.199596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df04b-8f9b-434b-86cb-b25d27a97acc None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.200275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df04b-8f9b-434b-86cb-b25d27a97acc None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.200758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5df04b-8f9b-434b-86cb-b25d27a97acc None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.202783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 27/57] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:23.208229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b0fa-a8ef-4dd1-8766-d6161c76ce55 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.208889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b0fa-a8ef-4dd1-8766-d6161c76ce55 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.209418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b0fa-a8ef-4dd1-8766-d6161c76ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.234989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1949b0fa-a8ef-4dd1-8766-d6161c76ce55 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:23.236600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1949b0fa-a8ef-4dd1-8766-d6161c76ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:23.326772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 31/58] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:23.337720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980cc2-6777-4863-9a5f-a5a83d5470c1 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.338271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980cc2-6777-4863-9a5f-a5a83d5470c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.338745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38980cc2-6777-4863-9a5f-a5a83d5470c1 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.340556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 28/59] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:23.345428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.345731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.346017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.374115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:23.375330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:23.428447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980cc2-6777-4863-9a5f-a5a83d5470c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:23.474570 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 32/60] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:23.529315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:23.608793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:23.669512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:23.728819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38980cc2-6777-4863-9a5f-a5a83d5470c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:23.773586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:23.774248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.774365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6b518-e212-47bd-8d1e-4ec925b4d4e5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:23.774529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.774806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.787441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-51bd07ee-cdee-443b-8a68-82075e66b7c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:23.792915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:23.793778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:23.794538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 29/61] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:23.797804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad010-6343-4694-9e6b-8b4dd4bfdf5f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.797804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad010-6343-4694-9e6b-8b4dd4bfdf5f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.797804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edad010-6343-4694-9e6b-8b4dd4bfdf5f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.797804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 30/62] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:23.802248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edad010-6343-4694-9e6b-8b4dd4bfdf5f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:23.824362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:23.825010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.825325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.825783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.836556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0a3d5b01-2ca1-40ad-a792-2932b099280d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:23.841613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:23.842467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:23.843236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 33/63] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:22:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:23.844611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.844719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.844914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.863399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:23.864651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:23.926864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edad010-6343-4694-9e6b-8b4dd4bfdf5f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:23.939641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:23.949162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 34/64] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:23.949162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:23.965328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:23.965952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:23.966234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:23.966655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:23.967470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:23.967922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:23.969531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:23.978658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 31/65] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:23.979708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:23.982511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.078997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fd7203-b5bf-46ae-aedd-7c71c645cd01 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.099910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18e147-1d0e-4ad2-80eb-f34e2ee30a97 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.116665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.117365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.118184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.118522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.128781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:24.134799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:24.135618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:24.136381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 35/66] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:24.137715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.138098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.139720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.139720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.139720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.140320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:24.141257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.141992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464ec9c-1862-4fac-afe7-5d067152dd37 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.150565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 32/67] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:22:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.155902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265937b-5bea-4bfc-adbf-c611493ede43 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.156190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265937b-5bea-4bfc-adbf-c611493ede43 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.156469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265937b-5bea-4bfc-adbf-c611493ede43 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.157726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 33/68] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:24.161337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265937b-5bea-4bfc-adbf-c611493ede43 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.195740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.225704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.245043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8057fb-36ad-4d9b-9fd9-70e54a866b94 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.271766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265937b-5bea-4bfc-adbf-c611493ede43 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.278505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.279138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.279418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.279689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.293308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.294888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.296495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 36/69] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.297369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.311589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.312205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.312482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.312806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.315869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:24.315869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.315869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45179677-93a0-44d0-9da4-5cc8b5c6c496 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.323730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 34/70] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.328320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.328320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.328320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.344844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:24.346070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:24.398421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d5309-43c2-48e8-9c35-5be45c2dca2b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.410919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 35/71] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:24.411749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.439169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.439803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.440086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.440367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.441533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.443242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.443472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.449246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 37/72] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.449246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.454042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.524624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4bf8e-4b82-46d3-82bd-5d4f61b24868 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.549316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830915a3-85e4-4190-a61c-b6ed13047fcd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.559155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.559793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.560074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.560346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.571397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:24.576142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:24.577018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:24.577814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:24.578445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.595976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.597112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.597656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.598542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.600412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.602496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.605208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 38/74] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.606430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.671315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.687185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14127d-dd43-427c-a89f-00d6a9442df6 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.696182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.720196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89f02f-ca35-4e2a-9d50-0139773e7f47 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.721966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.722617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.722907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.723192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] PATH_INFO: `/v3/users/02af815b1eff42b89905491a18971077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.724587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=02af815b1eff42b89905491a18971077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.726075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.728107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/users/02af815b1eff42b89905491a18971077 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.729479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.753601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.754242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.754526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.754803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.756152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.757803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.760797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 39/76] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.761551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.828291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89861-d565-4ead-ad64-a7a70b0ef6d4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.860871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.861528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.861806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.862076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.862738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:24.863042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.863195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b081b3a-3202-4e62-946c-e3e11dc97757 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.864418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.874406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 38/77] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:24.875192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.896547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:24.896775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:24.897538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:24.897538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:24.897779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/ca323088effc4beea6a3403c776de383/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:24.900235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, user_id=ca323088effc4beea6a3403c776de383, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:24.901836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:24.977494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a09469-33b4-4c0e-9b4d-3c09b81866fb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:24.978931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 40/78] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:24 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/ca323088effc4beea6a3403c776de383/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:24.979771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:24.982422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:25.017644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.018316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.018602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.018880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.020111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.021682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.023508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 39/79] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:25.024131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.098025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f87e141-0c13-4264-b441-cc5d55c83b31 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.118985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:25.138107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0380663-4734-44a5-866a-b31da028d1cf None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.139146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.139806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.140097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.140432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.141606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.143095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.149860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 41/80] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:24 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:25.149860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.179544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.180763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.181053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.181404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/ca323088effc4beea6a3403c776de383/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.183636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, user_id=ca323088effc4beea6a3403c776de383, role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.185116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.223282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:25.253977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7ec49-f9af-4878-b400-d72424498b11 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.287567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.288216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.288496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.288773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.290023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.298089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 40/81] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:25 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/ca323088effc4beea6a3403c776de383/roles/7bcc7d784f624412826cfb09306c7c53 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:25.298288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.298364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.298437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 42/82] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:25 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:25.298437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.433256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a9c8c-c240-4781-b55a-7ec0f8d4e9c7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.452512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0f11-6c57-4fe3-abee-c85768939a11 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.475888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.476095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.476347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.476636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/02af815b1eff42b89905491a18971077/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.480030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, user_id=02af815b1eff42b89905491a18971077, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.482006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.496469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.499111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.499111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.499111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.499111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.501624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.553940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:25.559377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 43/83] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:25 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/02af815b1eff42b89905491a18971077/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:25.565285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.625729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 41/84] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:25 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:25.626320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:25.703121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798fba8-8830-423a-ae76-c9dcfafef9ce None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.760461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.761214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.761504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.761784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] PATH_INFO: `/v3/projects/237ce725e5a24408ac70faac152675c9` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.766135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] RBAC: Authorizing `identity:get_project(project_id=237ce725e5a24408ac70faac152675c9)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.767695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b447b7-5a04-40f3-bb16-dc20abda72de None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:25.769940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 44/85] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:25 2022] GET /identity/v3/projects/237ce725e5a24408ac70faac152675c9 => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:25.775928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:25.922010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d136c8d-ceb8-457f-86d0-c67f18395aea None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:25.958976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:25.959585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:25.959871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:25.960153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] PATH_INFO: `/v3/projects/237ce725e5a24408ac70faac152675c9/users/ca323088effc4beea6a3403c776de383/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:25.962189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] RBAC: Authorizing `identity:create_grant(project_id=237ce725e5a24408ac70faac152675c9, user_id=ca323088effc4beea6a3403c776de383, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:25.963736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259f84f-e1bc-4ed7-9877-719fcbdca593 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:26.048225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 42/86] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:25 2022] PUT /identity/v3/projects/237ce725e5a24408ac70faac152675c9/users/ca323088effc4beea6a3403c776de383/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:27.406530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fdd4-de1d-4dde-8c05-a0533e8dcc93 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:27.407032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fdd4-de1d-4dde-8c05-a0533e8dcc93 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:27.407137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42fdd4-de1d-4dde-8c05-a0533e8dcc93 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:27.408743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 45/87] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:27.414001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b062a7-9ef2-4729-aa35-26bd67916937 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:27.414463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b062a7-9ef2-4729-aa35-26bd67916937 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:27.414636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b062a7-9ef2-4729-aa35-26bd67916937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:27.440176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-76b062a7-9ef2-4729-aa35-26bd67916937 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:27.441439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-76b062a7-9ef2-4729-aa35-26bd67916937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:27.513134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:27.524688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 43/88] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:27.965106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fdd4-de1d-4dde-8c05-a0533e8dcc93 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.011692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc7d9-b793-4447-8517-fa6efd5a1cc0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.012026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc7d9-b793-4447-8517-fa6efd5a1cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.012250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fc7d9-b793-4447-8517-fa6efd5a1cc0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.013783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 44/89] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:28.035276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.035559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.035839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.061294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:28.063881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:28.065103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:28.138709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42fdd4-de1d-4dde-8c05-a0533e8dcc93 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:28.171345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 45/90] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:28.197881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:28.198771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.199209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.199629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.215757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:28.225930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:28.227709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:28.228653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:28.230564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 46/91] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:28.236560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.366629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50998dda-4414-4c7d-bb26-902d231c0ad3 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:28.396924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:28.412143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:28.412784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.413075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.413386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.414069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:28.414619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:28.415799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:28.424278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 46/92] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:28.430229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.584580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.823070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db178b-4f2b-4c17-b1ba-317f99a0b36e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:28.877166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694b6a4-5f9c-47f7-a7be-fc27d1da87bf None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:28.877555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:28.893279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:28.893938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.894229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.894524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.897816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:28.902977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e42421-2077-4dbf-ad99-6f22a6386a98 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:28.902977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 47/93] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:28 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 471 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:28.902977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4da7c-c38e-4103-971e-72ef4d6b41f4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.902977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4da7c-c38e-4103-971e-72ef4d6b41f4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.902977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4da7c-c38e-4103-971e-72ef4d6b41f4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.903842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 48/94] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:28.912615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4da7c-c38e-4103-971e-72ef4d6b41f4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:28.942906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:28.943941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.944394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.944826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.957255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-ae0fad1c-d28b-4866-ba38-46486fb6f381 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:28.963126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:28.964177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:28.965100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:28.967706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 47/95] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:22:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:28.969174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:28.969644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:28.970112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:28.990352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:28.991896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:29.034466 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.072397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 48/96] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:29.073990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.176997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4da7c-c38e-4103-971e-72ef4d6b41f4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.245881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23188571-8bcc-4d5a-84e5-523c5456c021 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.280664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.281671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.282156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.282626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.289975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.290599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.290883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.291156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.291837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:29.292200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:29.293681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506cf1e-e5d6-47ab-b21d-bba11abe9270 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:29.310961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 49/97] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:29.312608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a588d7-da46-478a-984e-c7151f08122f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.312716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a588d7-da46-478a-984e-c7151f08122f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.312973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a588d7-da46-478a-984e-c7151f08122f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.316076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 50/98] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:29.319987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.320275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.320606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.343402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:29.344637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:29.364201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.372581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:29.374100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89e85d-8d2b-42f1-a3fd-b341d1a09b1a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:29.386926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.415923 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 51/99] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:29.416768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.494475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 49/100] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:29.496399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8127c-3dcd-4877-848b-7b9a843ac149 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.496767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8127c-3dcd-4877-848b-7b9a843ac149 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.497051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8127c-3dcd-4877-848b-7b9a843ac149 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.498536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 50/101] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:29.499419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061fb9-3156-4626-bb5e-228ce03b650e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.499787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061fb9-3156-4626-bb5e-228ce03b650e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.500074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6061fb9-3156-4626-bb5e-228ce03b650e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.501290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 51/102] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:29.502130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6061fb9-3156-4626-bb5e-228ce03b650e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.533705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f722e1-beab-4200-8a61-ad4eadb7aca2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.568723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.569383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.569665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.569937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.571239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:29.572699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:29.578723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 52/103] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:29.578723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.603172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.609224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.610965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6061fb9-3156-4626-bb5e-228ce03b650e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.645178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.645858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.646146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.646426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.657633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-510b0e2d-69e7-4812-96f7-87c465698be5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:29.662439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:29.663258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:29.664014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 52/104] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:29.665791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.665791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.665791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.686314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:29.687514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:29.688936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b60e7b-14b6-4008-a79d-53dc45d38e5a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.723945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.724576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.724854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.725155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.726274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:29.728320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073741f9-cc20-4f6f-8078-578f99f47042 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:29.730160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 53/105] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:29.731059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.731338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.731614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.748470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:29.749626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:29.760508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 53/106] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:29.761390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.818894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 54/107] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:29.819738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:29.860867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.880376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:29.905288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046794d-2abc-4ccb-9669-28ebb7a1f6df None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.940673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.941327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.941617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.941899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.956216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0067-ee02-4364-923e-1d9770a292c8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:29.993676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:29.994358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:29.994644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:29.994970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:29.995652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:29.995957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:29.997401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.006315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 55/108] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.011758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.029209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.031997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.108541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.117295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b870650-37c8-4d03-8753-05552bd0bf13 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.119369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.135734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 54/109] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:30.136538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.152463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.153106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.153413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.153693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.163925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:30.168834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:30.169695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:30.170486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 56/110] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:30.171097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.237648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77ce01-374e-45af-aadb-84e9d1262085 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.269717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90b56-3a14-470c-8a6a-7a1290d190a0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.271735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.272350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.272638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.272915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.273702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] RBAC: Adding query filter params (role.id=6fb6c940635c427694cb507fd7126d0b, scope.project.id=a5ef5486653341d983d5e653a1c3ac07, user.id=ca323088effc4beea6a3403c776de383) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:30.274018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.275473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.282756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 55/111] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/role_assignments?user.id=ca323088effc4beea6a3403c776de383&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=6fb6c940635c427694cb507fd7126d0b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.283548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.307560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.308783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.309070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.309375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] PATH_INFO: `/v3/users/02af815b1eff42b89905491a18971077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.310625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] RBAC: Authorizing `identity:get_user(user_id=02af815b1eff42b89905491a18971077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.312808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.316141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 57/112] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/users/02af815b1eff42b89905491a18971077 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.316141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.345349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.345549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.400771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15907f83-0e33-41ec-8460-a2381364c9e6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.431847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de55769-7436-4614-949d-c888a95cb13b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.438797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.439454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.439740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.440022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.441195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.442936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.444586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 56/113] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.446665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.475810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.476453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.476761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.477033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.490964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:30.496317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:30.497495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:30.498260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 58/114] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:30.498873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.557933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e0bc9-2f51-43c6-b12c-976c8714eded None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.574324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.583996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.591263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.591895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.592180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.592483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.594231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.595128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.596750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 57/115] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.597539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.603249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165ecc5-c16d-45ef-ac34-47acb071f245 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.638132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.638752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.639039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.639322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.639995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:30.640307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.641727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.649876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 59/116] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:30.650677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.695941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b19fc7-e438-4aeb-a2b3-6ff07d1f0a0e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.728631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.729263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.729548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.729826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.751556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c21578-8583-460b-aadc-e69cb1385d98 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.779444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.784039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:30.784643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:30.784947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:30.785242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:30.785894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.787337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.795463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:30.796917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:30.802532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:30.864979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 60/117] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:22:30 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:30.865953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.900234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 58/118] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:30.901332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:30.985397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5dd0b-5e31-4550-ac59-2d74f64d36bf None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:30.996290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.014515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da0dd6-ef5e-4888-a8e8-d12bdb75323b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.024584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.025254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.025600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.025878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.026618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:31.026926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.028352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.043656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 61/119] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.043656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.060948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.061634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.061946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.062228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.062977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] RBAC: Adding query filter params (role.id=7bcc7d784f624412826cfb09306c7c53, scope.project.id=a5ef5486653341d983d5e653a1c3ac07, user.id=ca323088effc4beea6a3403c776de383) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:31.063277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.064742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.071642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 59/120] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:30 2022] GET /identity/v3/role_assignments?user.id=ca323088effc4beea6a3403c776de383&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=7bcc7d784f624412826cfb09306c7c53 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.072448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.119113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.181395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc887f-8e10-46cc-a52f-49e343df9b66 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.205073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f690d5-df42-4484-b454-ac898aff6f2d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.228042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.229057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.229593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.230093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] PATH_INFO: `/v3/users/2714ac39d237472bb9d20096b8b6c3b4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.247885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.248431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.248716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.248994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.250217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.251568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] RBAC: Authorizing `identity:get_user(user_id=2714ac39d237472bb9d20096b8b6c3b4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.251943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.253030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.253809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 60/121] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.254437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.255399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 62/122] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/users/2714ac39d237472bb9d20096b8b6c3b4 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.262465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.275511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.385353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bf279-3678-4a51-afab-5a8354a8cda9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.389597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12b27-8d61-4d85-879f-546e70e63ed0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.405428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.420169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.420811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.421093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.421399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] PATH_INFO: `/v3/users/ca323088effc4beea6a3403c776de383` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.422527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ca323088effc4beea6a3403c776de383)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.423996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.430298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 61/123] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/users/ca323088effc4beea6a3403c776de383 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.430298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.437323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.437323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.437323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.437323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.437930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=a5ef5486653341d983d5e653a1c3ac07, user.id=02af815b1eff42b89905491a18971077) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:31.437930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.437930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.444304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 63/124] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/role_assignments?user.id=02af815b1eff42b89905491a18971077&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.452852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.550145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.569206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a37773-800f-45c2-82a3-c1eacaea96c1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.577072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d45c4f0-a84f-4653-84b4-1952934cdc3e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.609966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.610635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.610932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.611206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.612572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.614339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.614812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.615443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.615724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.616000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.616096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 62/125] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:31.622576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.674232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.701055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.702983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.741705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d30a05-030c-4a69-b93f-819e6a7574b0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.778303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.779201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.779656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.779935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/2714ac39d237472bb9d20096b8b6c3b4/roles/5179118826774a6db89d1dbaa68913d6` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.781946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, user_id=2714ac39d237472bb9d20096b8b6c3b4, role_id=5179118826774a6db89d1dbaa68913d6)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.783405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.812588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 64/126] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:31.818574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:31.849672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 63/127] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:31 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/users/2714ac39d237472bb9d20096b8b6c3b4/roles/5179118826774a6db89d1dbaa68913d6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:22:31.909256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:31.933597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883aa44-067e-4958-83b9-dc663fcf5e62 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:31.971270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:31.971928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:31.972211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:31.972490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] PATH_INFO: `/v3/projects/237ce725e5a24408ac70faac152675c9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:31.973797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] RBAC: Authorizing `identity:get_project(project_id=237ce725e5a24408ac70faac152675c9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:31.975367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286b717-c070-430d-bc8d-140c5ba8833c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:31.977386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 65/128] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/projects/237ce725e5a24408ac70faac152675c9 => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:31.983112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:32.000305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:32.091840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5e38-8530-4797-9212-8b49596c44e2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:32.126777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:32.127395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:32.127676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:32.127950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:32.128673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] RBAC: Adding query filter params (role.id=6fb6c940635c427694cb507fd7126d0b, scope.project.id=237ce725e5a24408ac70faac152675c9, user.id=ca323088effc4beea6a3403c776de383) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:32.128980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:32.130468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1e37f-1a83-4337-91d9-6639035ecd2a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:32.136543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 64/129] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:31 2022] GET /identity/v3/role_assignments?user.id=ca323088effc4beea6a3403c776de383&scope.project.id=237ce725e5a24408ac70faac152675c9&role.id=6fb6c940635c427694cb507fd7126d0b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:33.101827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec55e-f75f-42c0-b918-3eb9bc783b0d None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.102345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec55e-f75f-42c0-b918-3eb9bc783b0d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.102451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec55e-f75f-42c0-b918-3eb9bc783b0d None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.103730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 66/130] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:33.108969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.109414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.109573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.127406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:33.128609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:33.193264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 65/131] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:33.460741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec55e-f75f-42c0-b918-3eb9bc783b0d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:33.559104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec55e-f75f-42c0-b918-3eb9bc783b0d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:33.592036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:33.592669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.592951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.593261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.594367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:33.595858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce2a10-5f96-4aaa-bd0d-8d5666319ac1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:33.597447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 67/132] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:33.603627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:33.611789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:33.701953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4632f-6a9f-486c-9bb6-6f809bb5dfef None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:33.734977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:33.735521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:33.735805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:33.736082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:33.736747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:33.738228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770c6fa-7b13-4996-8f3c-88e1a66070ef None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:33.836072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 66/133] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:33 2022] POST /identity/v3/users => generated 283 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:34.008773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efee6-9b8b-40a3-b6e3-6aed410df058 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.008989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efee6-9b8b-40a3-b6e3-6aed410df058 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.009307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892efee6-9b8b-40a3-b6e3-6aed410df058 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:34.010672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 68/134] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:34.015979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.016276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.016558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:34.035006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:34.036203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:34.095298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:34.105679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 67/135] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:34.373497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efee6-9b8b-40a3-b6e3-6aed410df058 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:34.389666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:34.481558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892efee6-9b8b-40a3-b6e3-6aed410df058 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:34.516894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:34.517619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.517899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.518173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:34.528849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:34.533751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:34.534577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:34.535353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 69/136] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:34.541186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:34.646492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49265a-c2f5-4114-a847-c75ddec5808e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:34.683510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:34.684497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.684978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.685472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:34.686334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:34.686852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:34.688508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:34.697502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 68/137] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:34.708050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:34.780047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:34.806049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725631c-4e76-4158-a1c5-4a21b7726636 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:34.843885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:34.844528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.844811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.845087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] PATH_INFO: `/v3/users/2714ac39d237472bb9d20096b8b6c3b4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:34.846267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=2714ac39d237472bb9d20096b8b6c3b4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:34.847736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:34.849668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 70/138] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:34 2022] GET /identity/v3/users/2714ac39d237472bb9d20096b8b6c3b4 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:34.855745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:34.911664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:34.957261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303f01f-7f41-413b-adc3-a35466988943 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:34.993291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:34.993925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:34.994208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:34.994482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.066548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:35.068284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:35.127749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:35.175476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 69/139] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:35.180998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:35.285428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2683f7-502d-483a-9f8f-ba21e108b1b2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:35.321933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:35.322910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:35.323384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:35.323868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.325210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:35.326877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec63fd-4785-429c-84bc-bab9f335e6d3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:35.333338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 71/140] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:35 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:35.337162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:35.440157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443cef-5542-407b-b327-b35b187018b6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:35.477378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:35.477991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:35.478276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:35.478563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:35.479290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] RBAC: Adding query filter params (role.id=5179118826774a6db89d1dbaa68913d6, scope.project.id=a5ef5486653341d983d5e653a1c3ac07, user.id=2714ac39d237472bb9d20096b8b6c3b4) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:35.479599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:35.481045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380eca2-236b-43ab-b3f9-cd48c49022e2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:35.487165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 70/141] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:35 2022] GET /identity/v3/role_assignments?user.id=2714ac39d237472bb9d20096b8b6c3b4&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=5179118826774a6db89d1dbaa68913d6 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:36.163446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e85a9-57d8-4ea9-8c3d-d1691f372011 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.163969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e85a9-57d8-4ea9-8c3d-d1691f372011 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.164041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e85a9-57d8-4ea9-8c3d-d1691f372011 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.166069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 72/142] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:36.172045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe7bc-db1c-4e8f-8d9e-e6ecb23588ce None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.172541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe7bc-db1c-4e8f-8d9e-e6ecb23588ce None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.172609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fe7bc-db1c-4e8f-8d9e-e6ecb23588ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.193926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2d6fe7bc-db1c-4e8f-8d9e-e6ecb23588ce None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:36.195234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2d6fe7bc-db1c-4e8f-8d9e-e6ecb23588ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:36.212184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:36.269161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:36.292107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f02-7a3a-401f-b450-74f00ceaf51c None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.292391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f02-7a3a-401f-b450-74f00ceaf51c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.292674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22144f02-7a3a-401f-b450-74f00ceaf51c None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.294281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 73/144] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:36.299738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.300029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.300304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.311082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d30e-fc39-40bb-a20c-4996e91fe0a6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.311369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d30e-fc39-40bb-a20c-4996e91fe0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.311653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac9d30e-fc39-40bb-a20c-4996e91fe0a6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.312972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 74/145] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:36.318308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.318768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.319055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.319312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:36.320529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:36.340011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:36.341257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:36.345208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:36.397715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 72/146] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:36.414851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 75/147] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:36.538496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.619967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:36.641589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d967ea-12dd-4378-8246-bf4981f4bd29 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:36.667760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.677105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:36.677775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.678060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.678335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.688763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:36.693901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:36.694939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:36.696327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 73/148] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:36.700858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.765768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d9ee-3602-4abd-b8dc-6234958a8dc9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:36.799344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2dcc8-73ef-4238-aefb-8c76cd7849b8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:36.800356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:36.800990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.801298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.801632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.802738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:36.804213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:36.806396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 76/149] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:36.807162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.819303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:36.834240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:36.834877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.835156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.835460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.842279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:36.846087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:36.850920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:36.852401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:36.853219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 74/150] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:22:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:36.853904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.908341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc090d80-1afa-4111-abc9-2e67349eea24 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:36.942448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:36.943484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.943767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.944034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.944687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:36.944989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:36.946428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:36.951506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18be2c9-141d-4872-9c9a-4e9bcff1e0bb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:36.954180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 77/151] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:36.954957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:36.986621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:36.987227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:36.987509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:36.987784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:36.988545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:36.990043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.021906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.051801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac396826-9f3c-4516-bb84-6a5b960a3c08 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.083629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.084227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.084512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.084785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.085471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:37.085773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.087678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.087782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 75/152] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:36 2022] POST /identity/v3/users => generated 297 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:37.094161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.099215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 78/153] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:22:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:37.105917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.168772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.221607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83a818-d9e1-4971-9af2-c596d0114663 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.225559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba70f44-e2a0-42f9-99a1-081b84ac6ea9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.260483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.261151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.261435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.261710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] PATH_INFO: `/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.264504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.269183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.269982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.270266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.270542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] PATH_INFO: `/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.277814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] RBAC: Authorizing `identity:get_user(user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.279295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.280993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 76/154] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:37 2022] GET /identity/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:37.286482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.286691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] RBAC: Authorizing `identity:get_user(user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.288361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.291221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 79/155] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:37 2022] GET /identity/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:37.297397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.408198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5992e-98af-41f7-b897-195a368dcd8e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.421243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9ea08-f895-4cd8-b92c-77ebc4467e78 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.422853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.451786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.453097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.453404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.453674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.454818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.456270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.457997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 77/156] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:37 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:37.464469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.465754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.466413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.466695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.466973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.468167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.469798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.471684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 80/157] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:37 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:37.478811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:37.548908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:37.577739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484ce9a-5177-44fd-9a66-c6be955fa5c6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.607692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbc5d1d-67e8-41a2-819b-ee15476a7cf8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:37.624669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.625722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.626077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.626748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/70c1ff5cf2fd4f6aaf840d522bf45dfd/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.628734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.630783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56761dd-9c13-497e-9546-a46e2f3db54f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.645290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:37.645956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:37.646237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:37.646510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/70c1ff5cf2fd4f6aaf840d522bf45dfd/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:37.649399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd, role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:37.650863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c6249-7d4c-4802-be5e-b8182f93e44e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:37.697048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 78/158] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:37 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/70c1ff5cf2fd4f6aaf840d522bf45dfd/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:22:37.720642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 81/159] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:37 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/70c1ff5cf2fd4f6aaf840d522bf45dfd/roles/7bcc7d784f624412826cfb09306c7c53 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:39.393651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c38f-dfee-4f43-a271-4ee8074bfc34 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.394162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c38f-dfee-4f43-a271-4ee8074bfc34 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.394245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54c38f-dfee-4f43-a271-4ee8074bfc34 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.395546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 79/160] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:39.400860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd819b6-88f3-4b5c-8980-758f191c64fe None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.401317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd819b6-88f3-4b5c-8980-758f191c64fe None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.401440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd819b6-88f3-4b5c-8980-758f191c64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.420539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6cd819b6-88f3-4b5c-8980-758f191c64fe None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:39.422066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6cd819b6-88f3-4b5c-8980-758f191c64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:39.496458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 82/161] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:39.499054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef5f-d96a-4479-b143-22585d058b92 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.499327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef5f-d96a-4479-b143-22585d058b92 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.499601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8666ef5f-d96a-4479-b143-22585d058b92 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.501052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 80/162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:39.506110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.506406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.506670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.526001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:39.527186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:39.572910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:39.595704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 83/163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:39.772851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ef5f-d96a-4479-b143-22585d058b92 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:39.826998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:39.890715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:39.899312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8666ef5f-d96a-4479-b143-22585d058b92 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:39.936003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:39.936640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.936924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.937229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.948261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0e3c53a6-cb21-46ae-aaa3-fa0fd0680824 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:39.953000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:39.953890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:39.954694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 81/164] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:39.955428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842dbe0-53f4-4056-885d-c6b6e7ddb66e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.955679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842dbe0-53f4-4056-885d-c6b6e7ddb66e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.955951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842dbe0-53f4-4056-885d-c6b6e7ddb66e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.957317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 82/165] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:39.959399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db539c-65de-463a-93f0-c02b702d07a3 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:39.959681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db539c-65de-463a-93f0-c02b702d07a3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:39.959956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db539c-65de-463a-93f0-c02b702d07a3 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:39.962311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 83/166] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:39.963585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db539c-65de-463a-93f0-c02b702d07a3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.005172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52c973-4e5f-49a5-9eb4-2b6ef8b30eb5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.038682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.039334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.039616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.039888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.041836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.043293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeac114-4a73-4601-aa7e-d60ee907d59c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.045190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 84/167] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:40.046409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.046692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.046970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.064762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:40.064937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.066002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:40.068907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db539c-65de-463a-93f0-c02b702d07a3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.103924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.104528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.104812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.105087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.105785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:40.106091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.107485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94af0b7c-36ce-405d-889e-a0afb98b4424 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.108111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.116026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 84/168] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:40.118004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.118297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.118573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.132747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 85/169] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:40.134577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.136419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:40.137656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:40.215762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 85/170] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:40.218613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.245298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c8d091-fc83-472b-9bc6-6fdc82225d98 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.285637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.286258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.286542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.286819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.287481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.288926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.340955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.349827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ff182-b494-4686-ad37-ac04f3e2c1bd None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.378263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 86/171] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:40 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:40.395999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.397574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.398168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.398664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] PATH_INFO: `/v3/users/6b00ad98accc4685b461616df33c0734` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.399726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.483725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] RBAC: Authorizing `identity:get_user(user_id=6b00ad98accc4685b461616df33c0734)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.485148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.487158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 86/172] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/users/6b00ad98accc4685b461616df33c0734 => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:40.493421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.505852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.585437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95b3d0-5578-479e-ac2d-661125823224 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.613406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeea5c-86b0-48f8-9d9b-731d9359e3a0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.625675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.626323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.626602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.626874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.641089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:40.651132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:40.652180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 87/173] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:40.653068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.653797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.653797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.653797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.653797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.654045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.656951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.658470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 87/174] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:40.658655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.685010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.768423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.775587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a4f18-e82a-43b7-ab3c-21c058a61e00 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.799667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed53d2-94a2-4ab5-ac59-921cc0f22cd2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:40.828112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.829682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.830414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.830890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.837148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:40.837795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:40.838080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:40.838407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:40.839029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:40.839334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:40.841009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:40.845660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:40.849754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 88/175] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:40.853167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:40.855182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:40.856229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:40.857224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:40.860046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 88/176] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:40.864281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:40.945098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:40.966275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ace0c-2c92-474b-a0e4-b67f6f8ce4f6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.005340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.006368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.006545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ba463-b562-4a45-96d4-75de72c4ea62 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.007037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.007511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/6b00ad98accc4685b461616df33c0734/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.011445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, user_id=6b00ad98accc4685b461616df33c0734, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.013164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.043981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.044540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.044824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.045103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] PATH_INFO: `/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.046379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] RBAC: Authorizing `identity:get_user(user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.048133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.050048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 89/177] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:40 2022] GET /identity/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:41.050657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.079109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 89/178] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:40 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/6b00ad98accc4685b461616df33c0734/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:41.080309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.081824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.253422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddcee8d-03f6-4c72-b0f2-ebe3286ed659 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.292932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af51d3-e9f2-4984-a129-9e4c90f1a67b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.303738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.304288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.304562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.304961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.306155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:41.306482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.307852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.317960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 90/179] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:41.324446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.353015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.353676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.353960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.354230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.378308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.486473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.488968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.494920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.539827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b13c80-4bd9-445c-8b4c-02eda0278564 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.599327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 90/180] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:41.605717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.612903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.613661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.613966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.614390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] PATH_INFO: `/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.615613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] RBAC: Authorizing `identity:get_user(user_id=70c1ff5cf2fd4f6aaf840d522bf45dfd)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.617180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.619461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 91/181] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/users/70c1ff5cf2fd4f6aaf840d522bf45dfd => generated 283 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:41.629281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.661000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.723170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e7946-4cd6-4d37-9902-16ced82f45c3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.764089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.765190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.765576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.766038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.767493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.769160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.772254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 91/182] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:41.780280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:41.843075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14fcf4-745b-41ab-bf21-845ba42978cd None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.897996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aadb09-02ed-4667-b608-b7eb929b50a6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:41.910110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.910480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.910763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.911040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.911565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.943066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:41.943696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:41.943980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:41.944254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:41.944993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] RBAC: Adding query filter params (role.id=7bcc7d784f624412826cfb09306c7c53, scope.project.id=e31c07f4cd41495289dd5ac774367d1a, user.id=70c1ff5cf2fd4f6aaf840d522bf45dfd) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:41.946225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:41.947697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:41.952390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:41.960416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 92/183] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/role_assignments?user.id=70c1ff5cf2fd4f6aaf840d522bf45dfd&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=7bcc7d784f624412826cfb09306c7c53 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:42.012256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:42.013811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:42.158183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 92/184] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:42.164133 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:42.299953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ed1c8a-031e-4246-b731-a5c55cbcb01d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:42.333860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:42.334499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:42.334778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:42.335049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.336709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:42.338192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d208-771c-4326-856d-8b550be2f24c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:42.339829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 93/185] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:42 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:42.345888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:42.408528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:42.467708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fa36c-a24f-403e-96fa-68be5d8914c5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:42.509257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:42.509880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:42.510159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:42.510437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.511176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=e31c07f4cd41495289dd5ac774367d1a, user.id=70c1ff5cf2fd4f6aaf840d522bf45dfd) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:42.511486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:42.512928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffea012-1b94-404b-b84f-9b5457a0deb5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:42.519262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 93/186] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:42 2022] GET /identity/v3/role_assignments?user.id=70c1ff5cf2fd4f6aaf840d522bf45dfd&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:42.941452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224387-c51e-4149-9652-09a78f2c9243 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:42.941997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224387-c51e-4149-9652-09a78f2c9243 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:42.941997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a224387-c51e-4149-9652-09a78f2c9243 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.943665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 94/187] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:42.949435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:42.949812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:42.949978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:42.968550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:42.969775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:43.025673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923729-338b-4833-a36d-490688f7bd77 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.025991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923729-338b-4833-a36d-490688f7bd77 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.026261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d923729-338b-4833-a36d-490688f7bd77 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.027728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 95/188] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:43.032315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.032604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.032882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.039774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 94/189] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:43.051040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:43.052333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:43.088149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:43.121311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 96/190] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:43.307509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.357381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:43.387954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.419698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea6381-3edd-4364-ba8a-c26a5a2925c2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:43.455237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:43.455878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.456156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.456427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.457559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:43.459000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:43.460803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 95/191] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:43.465954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.492273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf73a4-a155-4089-aa46-d5d8317c0a06 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:43.526109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:43.526744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.527023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.527292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.537190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9d40aa74-1713-433d-8483-b87f9fd8fd68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:43.542568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:43.543670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:43.544534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 97/192] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:43.545273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576e47b-bb68-485e-b0e7-410a7a033fcb None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.545273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576e47b-bb68-485e-b0e7-410a7a033fcb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.545466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576e47b-bb68-485e-b0e7-410a7a033fcb None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.547204 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 98/193] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:43.549247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576e47b-bb68-485e-b0e7-410a7a033fcb None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.569456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a44511-b351-41d8-9e58-ec658e08fe57 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:43.580039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:43.581996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:43.602777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:43.603434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.603717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.603985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.604634 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:43.606108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:43.650807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576e47b-bb68-485e-b0e7-410a7a033fcb None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:43.684746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:43.685372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.685653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.685923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.686579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:43.686879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:43.688329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e499447b-f365-40d4-abef-76993ce5a83e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:43.696415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 99/194] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:43.701011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.701011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.701011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.720280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 96/195] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:43 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:22:43.720280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.720609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:43.720609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:43.806271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 100/196] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:43.826124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbb6e9-df81-456b-b242-88c58aa614c7 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:43.863299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:43.863952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:43.864228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:43.864499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] PATH_INFO: `/v3/users/66d0a5241244404e8401348854c834f9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:43.880193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] RBAC: Authorizing `identity:get_user(user_id=66d0a5241244404e8401348854c834f9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:43.881760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:43.884078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 97/197] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:43 2022] GET /identity/v3/users/66d0a5241244404e8401348854c834f9 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:43.889887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:43.918096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:43.995303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c24e9-6850-4b71-a564-0a9b2f30673b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.033993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.034635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.034912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.035181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.036291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:44.037802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:44.041261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 101/198] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:43 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:44.045506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:44.077059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:44.078260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.154496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fddbe0-06f5-4e93-b8d3-7128ce92d282 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.179590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.190622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e930b76-22de-40fe-babd-947dfe9eef11 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.201825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.202527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.202782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.203061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/66d0a5241244404e8401348854c834f9/roles/5179118826774a6db89d1dbaa68913d6` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.205019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, user_id=66d0a5241244404e8401348854c834f9, role_id=5179118826774a6db89d1dbaa68913d6)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:44.207076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:44.230926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.231562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.231919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.232155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.243382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:44.248190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:44.249064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:44.249883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 102/199] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:44.255283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:44.296492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 98/200] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:22:44 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/users/66d0a5241244404e8401348854c834f9/roles/5179118826774a6db89d1dbaa68913d6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:44.374501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920fdeb-10f3-4f30-a588-02ecee7f036f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.413059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.413944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.414958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.415387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.416306 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:44.416772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:44.418390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:44.428148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 103/201] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:44.435003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:44.534768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.551083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb202ebc-165c-4c9b-94e0-1005ac4edd96 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.588238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.589238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.589654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.590061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] PATH_INFO: `/v3/users/6b00ad98accc4685b461616df33c0734` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.591446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] RBAC: Authorizing `identity:get_user(user_id=6b00ad98accc4685b461616df33c0734)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:44.593149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:44.594898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 99/202] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:44 2022] GET /identity/v3/users/6b00ad98accc4685b461616df33c0734 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:44.600689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:44.618780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.709012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad2ac5-e584-463c-a814-69cdd190d30f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:44.747406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:44.748027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:44.748309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:44.748583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:44.822523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:44.824263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:44.840619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:44.931365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 104/203] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:44.936959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:45.039895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ed02e-4d82-4acc-9906-13a31c58bd40 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:45.075861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:45.076598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:45.076788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:45.077349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:45.078653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:45.080565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453858d0-5a3c-4a3c-8087-c5c6498642af None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:45.082542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 100/204] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:44 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:45.089035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:45.195020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab99fc-fea1-4151-81d2-a0935e706563 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:45.209634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:45.232007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:45.232629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:45.232923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:45.233220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:45.233956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] RBAC: Adding query filter params (role.id=6fb6c940635c427694cb507fd7126d0b, scope.project.id=e31c07f4cd41495289dd5ac774367d1a, user.id=6b00ad98accc4685b461616df33c0734) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:45.234265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:45.235712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d749f19-4648-4c68-82be-e391098403ef None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:45.242125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 105/205] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:45 2022] GET /identity/v3/role_assignments?user.id=6b00ad98accc4685b461616df33c0734&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=6fb6c940635c427694cb507fd7126d0b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:46.058166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192e9-b691-42d0-9994-d6d43826dda5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.058552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192e9-b691-42d0-9994-d6d43826dda5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.058739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc192e9-b691-42d0-9994-d6d43826dda5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.060226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 101/206] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:46.065266 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.065556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.065830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.084557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:46.085787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:46.126848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330fc11-f13f-456d-80f6-1ffdac74a064 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.127392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330fc11-f13f-456d-80f6-1ffdac74a064 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.127392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330fc11-f13f-456d-80f6-1ffdac74a064 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.128863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 102/207] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:46.134586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.134861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.135143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.153932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:46.155104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:46.156766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 106/208] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:46.172252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:46.222463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 103/209] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:46.436927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:46.492890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:46.554737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85759dca-8d27-4590-bf59-4cc7696ae742 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:46.562360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:46.590039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:46.590675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.590959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.591240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.597505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96208aed-9cfc-4c2b-ab92-3a00398ea85d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:46.601304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fdf6a5c8-32d2-4997-ac93-3e6d3f29cc05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:46.606155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:46.607077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:46.607863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 107/210] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:46.610700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6eb0-7140-4fdc-b017-e88e21244b93 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.610993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6eb0-7140-4fdc-b017-e88e21244b93 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.611273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c6eb0-7140-4fdc-b017-e88e21244b93 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.612571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 108/211] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:46.613304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6eb0-7140-4fdc-b017-e88e21244b93 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:46.634520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:46.635174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.635458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.635736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.637333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:46.638779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069dee4-51ce-4c60-8c4a-a4716e324496 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:46.640468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 104/212] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:46.641459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.641742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.642013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.659597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:46.660788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:46.674500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:46.718507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c6eb0-7140-4fdc-b017-e88e21244b93 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:46.726747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 105/213] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:46.733498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:46.754872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:46.755643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.755921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.756523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.757229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:46.757535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:46.759467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:46.767924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 109/214] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:46.772955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:46.801213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:46.838537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65648a74-5e22-4300-8eec-675eb84bf48f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:46.876879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:46.877445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.877724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.877997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.878289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bb18a-c9e2-4493-b771-dabd545cd604 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:46.878641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:46.880092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:46.913432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:46.914062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:46.914367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:46.914641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] PATH_INFO: `/v3/users/2ab7736e13f64e718a79bd02a22cd9fe` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:46.927435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab7736e13f64e718a79bd02a22cd9fe)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:46.928954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:46.931118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 110/215] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:46 2022] GET /identity/v3/users/2ab7736e13f64e718a79bd02a22cd9fe => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:46.936691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.007210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 106/216] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:22:46 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:47.009040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.018566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.022335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.044012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e170e-cf6f-4807-b2aa-763058cd8121 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.088478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.089247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.089553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.089950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.090601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] RBAC: Adding query filter params (role.id=6fb6c940635c427694cb507fd7126d0b, user.id=2ab7736e13f64e718a79bd02a22cd9fe, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:47.091345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:47.093729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:47.099851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 111/217] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Oct 12 12:22:46 2022] GET /identity/v3/role_assignments?user.id=2ab7736e13f64e718a79bd02a22cd9fe&scope.system=all&role.id=6fb6c940635c427694cb507fd7126d0b => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:47.122471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f47cc-600e-41b6-82d8-ede8e666b4e4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.163592 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.164803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.165069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.165305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.178144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:47.184519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:47.185523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:47.186283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 107/218] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:47.193046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.309344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108076e-bcf8-43a1-91ea-fcb5e16cdba9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.349190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:47.356642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:47.362051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 112/219] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:47.368406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.439837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.475538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2230b1-81a4-4fd1-be94-fd12ef28c204 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.514989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.515630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.515909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.516182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] PATH_INFO: `/v3/users/66d0a5241244404e8401348854c834f9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.517350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] RBAC: Authorizing `identity:get_user(user_id=66d0a5241244404e8401348854c834f9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:47.518814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:47.520598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 108/220] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:47 2022] GET /identity/v3/users/66d0a5241244404e8401348854c834f9 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:47.526652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.543154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.632284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc0c8f-d829-4b07-96e3-3d4d3875e407 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.667793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.668402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.668678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.668947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.739178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:47.740720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:47.754743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:47.843569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 113/221] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:22:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:22:47.849251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:47.955628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4d33c-5c7f-4d34-a207-111b295da4c9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:47.991457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:47.992020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:47.992298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:47.992604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:47.993762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:47.995213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f8c43-ce59-430b-b673-f27046643ae5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:47.996860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 109/222] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:22:47 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:48.003053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:48.112931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53246689-03fb-497f-ac36-e491bc96f8ce None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:48.126235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:48.152670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:48.153312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:48.153589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:48.153859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:48.154578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] RBAC: Adding query filter params (role.id=5179118826774a6db89d1dbaa68913d6, scope.project.id=e31c07f4cd41495289dd5ac774367d1a, user.id=66d0a5241244404e8401348854c834f9) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:48.154881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:48.156326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e071c-b4b5-44a7-9aea-af2d17c286f5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:48.162446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 114/223] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:22:48 2022] GET /identity/v3/role_assignments?user.id=66d0a5241244404e8401348854c834f9&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=5179118826774a6db89d1dbaa68913d6 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:49.295110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc800e1-6357-4c37-9328-eae2cf5de879 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.295640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc800e1-6357-4c37-9328-eae2cf5de879 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.295640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc800e1-6357-4c37-9328-eae2cf5de879 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.297328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 110/224] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:49.302514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad01e4-eba9-4381-8017-07808f19fe93 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.302890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad01e4-eba9-4381-8017-07808f19fe93 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.303064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad01e4-eba9-4381-8017-07808f19fe93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.321474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68830-8876-42a3-ba2b-d81c00af611e None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.321771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68830-8876-42a3-ba2b-d81c00af611e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.322037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff68830-8876-42a3-ba2b-d81c00af611e None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.323500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 111/225] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:22:49.323815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-eaad01e4-eba9-4381-8017-07808f19fe93 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:49.326849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eaad01e4-eba9-4381-8017-07808f19fe93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:49.329571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b45bc-25bc-4eb6-9821-d655d8ed6344 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.329866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b45bc-25bc-4eb6-9821-d655d8ed6344 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.330151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b45bc-25bc-4eb6-9821-d655d8ed6344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.337909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:49.348656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8d6b45bc-25bc-4eb6-9821-d655d8ed6344 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:49.349896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8d6b45bc-25bc-4eb6-9821-d655d8ed6344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:49.403067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 115/226] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:49.425976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 112/227] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:49.490847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3f50-fb24-44c2-8a2a-0efb1f2eeed9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.491131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3f50-fb24-44c2-8a2a-0efb1f2eeed9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.491395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3f50-fb24-44c2-8a2a-0efb1f2eeed9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.493512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 116/228] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:49.498438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.498814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.499159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.517308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:49.518568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:49.589196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 113/229] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:49.665809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3f50-fb24-44c2-8a2a-0efb1f2eeed9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:49.690077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:49.757784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:49.772218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3f50-fb24-44c2-8a2a-0efb1f2eeed9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:49.781964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:49.800651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515823a-f4ec-4fc8-a3af-d85a165812b0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:49.809793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:49.810818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.811102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.811375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.823402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:49.828269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:49.829775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:49.830567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 117/230] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:49.835131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:49.840338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:49.840930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.841238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.841515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.853623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:49.860003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:49.860863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:49.861681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 114/231] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:49.862318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:49.944205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ac0ae-f037-4381-b591-70db408cc206 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:49.977981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4675ebe-b39b-4b43-82d2-c2701d661512 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:49.978959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:49.979576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:49.979857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:49.980132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:49.980803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:49.981107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:49.982518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:49.990705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 118/232] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:49.991526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.004279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:50.015426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.016060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.016345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.016610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.026173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.026173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.026350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:50.026423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 115/233] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:50.026423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.092118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96079-702b-41de-9f82-e75307e75981 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.122217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9d03ea-6cbf-4593-988e-8eb4e68eac2b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.124305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.124918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.125225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.125504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.126160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:50.126462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.127860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.136382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 119/234] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:50.137209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.157860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.158501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.158792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.159070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] PATH_INFO: `/v3/users/2ab7736e13f64e718a79bd02a22cd9fe` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.160202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] RBAC: Authorizing `identity:get_user(user_id=2ab7736e13f64e718a79bd02a22cd9fe)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.161687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.165168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 116/235] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:50 2022] GET /identity/v3/users/2ab7736e13f64e718a79bd02a22cd9fe => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:50.165168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.221279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:50.236548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:50.245965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203abd60-1eaf-4eaa-94e6-c7686836fb57 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.262283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9915-cb73-4ef0-8da8-2c86795fe0af None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.280556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.281192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.281477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.281751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] PATH_INFO: `/v3/groups` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.282379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.283942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.296420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.297067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.297374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.297650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] PATH_INFO: `/v3/users/99215b2d2279474aaeba0a9a2d93e315` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.311854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] RBAC: Authorizing `identity:get_user(user_id=99215b2d2279474aaeba0a9a2d93e315)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.313378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.315055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 117/236] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:50 2022] GET /identity/v3/users/99215b2d2279474aaeba0a9a2d93e315 => generated 293 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:50.315812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.353626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 120/237] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Oct 12 12:22:50 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:22:50.354511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:50.439971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f9f3-cc68-4be5-8fcc-80dc5eb95190 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.458609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:50.472757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c66005-a491-4aa2-bd54-364c559be95c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:50.478613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.479301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.479585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.479863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] PATH_INFO: `/v3/system/users/2ab7736e13f64e718a79bd02a22cd9fe/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.481445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ab7736e13f64e718a79bd02a22cd9fe, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.482910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e08e4c-cb7d-435a-9e36-992503563978 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.510175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:50.510879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:50.511158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:50.511425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:50.512158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] RBAC: Adding query filter params (role.id=5179118826774a6db89d1dbaa68913d6, user.id=99215b2d2279474aaeba0a9a2d93e315, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:50.512461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:50.513968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a02f4d-e35b-4fdd-92b6-f4d2c3ded3f2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:50.519669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 121/238] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Oct 12 12:22:50 2022] GET /identity/v3/role_assignments?user.id=99215b2d2279474aaeba0a9a2d93e315&scope.system=all&role.id=5179118826774a6db89d1dbaa68913d6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:50.588891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 118/239] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Oct 12 12:22:50 2022] PUT /identity/v3/system/users/2ab7736e13f64e718a79bd02a22cd9fe/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:52.527334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8da699-27c9-4111-b0c4-9285e9de4cd5 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.527901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8da699-27c9-4111-b0c4-9285e9de4cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.527901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8da699-27c9-4111-b0c4-9285e9de4cd5 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.529514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 122/240] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:52.535159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517fdd-a7d0-41ac-b2da-5567334383fd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.535686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517fdd-a7d0-41ac-b2da-5567334383fd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.535686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79517fdd-a7d0-41ac-b2da-5567334383fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.555953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-79517fdd-a7d0-41ac-b2da-5567334383fd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:52.557194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-79517fdd-a7d0-41ac-b2da-5567334383fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:52.625911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 119/241] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:52.654580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e2d0-4728-4fd8-ae5f-a4e1b5d7179a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.654884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e2d0-4728-4fd8-ae5f-a4e1b5d7179a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.655124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d132e2d0-4728-4fd8-ae5f-a4e1b5d7179a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.656603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 123/242] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:52.661593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.661879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.662151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.681259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:52.682430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:52.736874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88446e-3e47-439e-bee6-7877c89dbd0a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.737190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88446e-3e47-439e-bee6-7877c89dbd0a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.737476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88446e-3e47-439e-bee6-7877c89dbd0a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.738973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 124/243] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:52.743646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:52.743927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:52.744210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:52.750698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 120/244] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:52.762103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:52.763312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:52.773059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:52.829962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 125/245] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:22:52.891302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:52.935442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:52.992136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c1b87-3f97-4e32-aa81-a19500fef987 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.015329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.028180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.028965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.029281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.029554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.030818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.032674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.034416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 121/246] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:22:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:53.040209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.118114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a145292-c274-46f8-9b0c-bad1dd429cb9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.139860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dc147-cff2-4ca3-aee6-4f48e0591a4f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.148539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.152510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.153161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.153444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.153715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.163964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:53.168759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:53.169676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:53.170472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 126/247] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:22:53.171129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.174474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.175096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.175716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.175994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.176265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] PATH_INFO: `/v3/groups` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.176900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.178376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.265418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bae42-6dd4-49e7-88bc-cba21ea35eca None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.292688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 122/248] 10.222.0.50 () {60 vars in 1134 bytes} [Wed Oct 12 12:22:53 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:22:53.293747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.301871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.302537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.302821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.303225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.315857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:53.323156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:53.324090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:53.324872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 127/249] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:53.331016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.403958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.423056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0620ef0-a575-4424-bdfb-421e31a1569c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.450866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797661bd-7ebf-46aa-a788-bf22bef6d468 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.461888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.462578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.462900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.463130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.463889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:53.464192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.465614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.475367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 123/250] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:53.480693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.493909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.494527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.494808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.495081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.495753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:53.496077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.497494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.506493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 128/251] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:53.513538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.515655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.615276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf58e7-9306-4c1b-8a55-5e019906b756 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.645316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d321e09-a73e-4a1e-81ec-46dc32a5f155 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.661069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.661689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.661974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.662239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] PATH_INFO: `/v3/users/99215b2d2279474aaeba0a9a2d93e315` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.663868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] RBAC: Authorizing `identity:get_user(user_id=99215b2d2279474aaeba0a9a2d93e315)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.665382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.667318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 124/252] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/users/99215b2d2279474aaeba0a9a2d93e315 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:53.673147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.676399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.686692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.687622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.690558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.690558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] PATH_INFO: `/v3/users/2ab7736e13f64e718a79bd02a22cd9fe` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.690558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] RBAC: Authorizing `identity:get_user(user_id=2ab7736e13f64e718a79bd02a22cd9fe)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.691696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.693801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 129/253] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/users/2ab7736e13f64e718a79bd02a22cd9fe => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:53.702098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:53.794216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:53.798799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f473c-7de8-49f0-a8a3-c40b54117351 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.829817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1296f61-1a20-463d-ac18-f08471019b61 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:53.845104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.845853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.846190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.846641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] PATH_INFO: `/v3/system/users/99215b2d2279474aaeba0a9a2d93e315/roles/5179118826774a6db89d1dbaa68913d6` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.848410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=99215b2d2279474aaeba0a9a2d93e315, role_id=5179118826774a6db89d1dbaa68913d6)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.850607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a773588-33a3-4dd8-a677-5cbf84be85d1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.876987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:53.877649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:53.877966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:53.878237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:53.878968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] RBAC: Adding query filter params (role.id=6fb6c940635c427694cb507fd7126d0b, user.id=2ab7736e13f64e718a79bd02a22cd9fe, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:53.879272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:53.880811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae98694-f598-4a06-ad05-df251d700e75 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:53.894276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 130/254] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Oct 12 12:22:53 2022] GET /identity/v3/role_assignments?user.id=2ab7736e13f64e718a79bd02a22cd9fe&scope.system=all&role.id=6fb6c940635c427694cb507fd7126d0b => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:53.911980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 125/255] 10.222.0.50 () {58 vars in 1334 bytes} [Wed Oct 12 12:22:53 2022] PUT /identity/v3/system/users/99215b2d2279474aaeba0a9a2d93e315/roles/5179118826774a6db89d1dbaa68913d6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:55.796079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1731cf-7fb2-4b24-a5e8-65dda02b68f6 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:55.796592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1731cf-7fb2-4b24-a5e8-65dda02b68f6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:55.796592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1731cf-7fb2-4b24-a5e8-65dda02b68f6 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:55.798228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 131/256] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:55.804243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2319-83c4-4a15-b10e-3fc7d7a9ffad None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:55.804797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2319-83c4-4a15-b10e-3fc7d7a9ffad None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:55.804872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b2319-83c4-4a15-b10e-3fc7d7a9ffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:55.830323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-775b2319-83c4-4a15-b10e-3fc7d7a9ffad None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:55.831571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-775b2319-83c4-4a15-b10e-3fc7d7a9ffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:55.916653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 126/257] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:22:55.969687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1702-acde-41b2-a9da-ddc5fc2cac92 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:55.970011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1702-acde-41b2-a9da-ddc5fc2cac92 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:55.970244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db1702-acde-41b2-a9da-ddc5fc2cac92 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:55.971941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 132/258] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:55.978058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:55.978345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:55.978620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.003112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:56.004324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:56.015221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 127/259] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:22:56.441642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db1702-acde-41b2-a9da-ddc5fc2cac92 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.451416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.459219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db1702-acde-41b2-a9da-ddc5fc2cac92 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.469431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.470069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.470351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.470620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.473204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43d409-6f2e-4b8e-988c-b5bc959a7522 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.484024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.484664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.484941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.485241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.497002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:56.503365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:56.505897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:56.507845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 133/260] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:56.514154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:56.516577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:56.530736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:56.533181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:56.535141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 128/261] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:56.536725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fc128-6778-432c-aa6f-279bb5d7e63b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.544055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.552648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.553298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.553577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.553851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.554516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:56.554815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.556735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.556735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:22:56.556735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:22:56.565269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ca79d-0f45-496b-bc8b-c75877512461 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.566737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.574213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.574850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.579015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.579273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.579959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:56.580265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.585181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.585181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:22:56.585181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:22:56.587806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.591172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 134/262] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:56.599258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.609666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 129/263] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:56.613920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2721-eab6-451f-8b25-85e8dab0979c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.618190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.630208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.630858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.633608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.633897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.635855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995532a-5852-4326-b6f7-6833f68d0b8f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.652456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.653749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.653945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.654116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.654773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.654773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:22:56.654773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:22:56.655783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.656920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.657595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.658607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.658607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:22:56.658607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:22:56.661630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.662354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 135/264] 10.222.0.50 () {56 vars in 1201 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:56.663570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 130/265] 10.222.0.50 () {56 vars in 1201 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:56.669729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.674776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.693405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b847e-82a7-462e-94b2-3df9c0df7c61 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.694991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff785c7a-5d18-4333-aacf-1ddb8aad5f97 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.701099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.701928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.702308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.702704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.704290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.707788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.708485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.709425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.709705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.709934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48abc-3613-477e-a28c-7f8ec3a2d763 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.712780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.713724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 131/266] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:56.716649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1192df1-d484-40ef-b5d8-956fa093fd59 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.716851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529e81-148c-4557-88f5-d0f192233b38 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.717105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529e81-148c-4557-88f5-d0f192233b38 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.717399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3529e81-148c-4557-88f5-d0f192233b38 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.718663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 132/267] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:56.721137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529e81-148c-4557-88f5-d0f192233b38 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.721422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 136/268] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:56 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:56.724546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.724825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.725159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.749580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3529e81-148c-4557-88f5-d0f192233b38 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.758683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.759729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.760007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.760282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/groups/ee869eb8ed74447f924cb378bc4abb18/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.762710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:56.764358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:56.766045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, group_id=ee869eb8ed74447f924cb378bc4abb18, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.767088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.767088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:22:56.767088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:22:56.770854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:56.790370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:56.854462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 137/269] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:22:56.857978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:56.862220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 133/270] 10.222.0.50 () {58 vars in 1463 bytes} [Wed Oct 12 12:22:56 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/groups/ee869eb8ed74447f924cb378bc4abb18/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:56.939834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0850af-dd70-46ab-90e4-bf91c37785b0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:56.948343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:56.949024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:56.949329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:56.949649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07/groups/ee869eb8ed74447f924cb378bc4abb18/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:56.951808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ef5486653341d983d5e653a1c3ac07, group_id=ee869eb8ed74447f924cb378bc4abb18, role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:56.952851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:22:56.952851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:22:56.952851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:22:56.954862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c34746-c808-4abd-85f8-e870bd01c88a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:57.075367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 138/271] 10.222.0.50 () {58 vars in 1463 bytes} [Wed Oct 12 12:22:56 2022] PUT /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07/groups/ee869eb8ed74447f924cb378bc4abb18/roles/7bcc7d784f624412826cfb09306c7c53 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:57.216262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:57.293497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:57.352756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8780ee7-eb47-453d-a7ed-d318850b23fd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:57.400818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:57.401513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.401795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.402073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.412017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d92d-e724-45bd-b6ba-50a7cbd352f1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.412671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d92d-e724-45bd-b6ba-50a7cbd352f1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.413173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41d92d-e724-45bd-b6ba-50a7cbd352f1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.414775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 139/272] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:57.418778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6a8f-a998-48a0-a069-60507548791b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.419446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6a8f-a998-48a0-a069-60507548791b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.419702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:57.420141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e6a8f-a998-48a0-a069-60507548791b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.422779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 140/273] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:57.424132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.424609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-320c62d3-688e-4e7e-97a3-bfab1fa95f3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:57.425073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:57.427335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 12 12:22:57.428119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:57.428699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.428766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 134/274] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:57.428766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.428766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.428766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.450189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:57.450416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:57.457988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:57.458678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:57.521472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 141/275] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:22:57.522382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:57.526211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 135/276] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 12 12:22:57.559033 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:57.638180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2c331-57e0-4076-932d-9242799353ed None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:57.681114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:57.681941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.682226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.682503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.683178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:57.683505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:57.684871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:57.694202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 142/277] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:57.700185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:57.789258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:57.829934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b228a6b-5a32-4b38-bc49-850c619bd44f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:57.869470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:57.870220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:57.870463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:57.870741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] PATH_INFO: `/v3/users/99215b2d2279474aaeba0a9a2d93e315` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:57.871905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] RBAC: Authorizing `identity:get_user(user_id=99215b2d2279474aaeba0a9a2d93e315)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:57.873417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:57.875441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 136/278] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/users/99215b2d2279474aaeba0a9a2d93e315 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:57.881010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:57.995679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.008389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:22:58.015039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c542f18b-7721-4850-aa27-76f84140ec63 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.033441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d72fa2-4146-4577-abc0-f0aa5d2128a2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.033570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.033570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.033570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.033570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.046382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:58.051210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:58.052062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:58.053259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 137/279] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:58.058926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.059547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.059828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.060102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.060832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] RBAC: Adding query filter params (role.id=5179118826774a6db89d1dbaa68913d6, user.id=99215b2d2279474aaeba0a9a2d93e315, scope.system=all) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:58.061150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.062077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.063824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.077007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 143/280] 10.222.0.50 () {56 vars in 1308 bytes} [Wed Oct 12 12:22:57 2022] GET /identity/v3/role_assignments?user.id=99215b2d2279474aaeba0a9a2d93e315&scope.system=all&role.id=5179118826774a6db89d1dbaa68913d6 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:58.077896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.082353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f6c966-c115-4068-9131-3e05814f689e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.092982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263809a0-eda3-4cb6-a42b-db18d9313f0a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.097958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.098938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.099366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.099579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.099861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.100137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.100479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.100831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:58.101168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.101421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.103592 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.120982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 138/281] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:58.129343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:58.129894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:58.134997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:58.135938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:22:58.136722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:22:58.139580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 144/282] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:58.147146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.148241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b690e54-ed70-4da4-be86-8b411428c9dc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.156407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.157221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.157578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.157931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.159677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6f777-c7f3-4739-ae18-4491cc370f4d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.160151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.162582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.165317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 139/283] 10.222.0.50 () {56 vars in 1201 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:58.165963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.166827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.167299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.167760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.168627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:58.173164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.175046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.178797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.191845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 145/284] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:58.195872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae8479-b528-4b5e-b969-de6506e5b1af admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.202496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.215305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.218547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.219074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.219544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.220949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830c68-c510-4bc3-9fbf-46203ec4a519 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.221863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.228034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.231877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.232525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 140/285] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:58.237586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.238207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.238694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.240189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.242484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.244849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 146/286] 10.222.0.50 () {56 vars in 1201 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:22:58.247507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.258730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6fee24-6779-4cb2-ad38-8d3dc8820267 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.264434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.271827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.277034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.277594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.278063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/groups/ee869eb8ed74447f924cb378bc4abb18/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.278385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d307-2cf2-4198-981c-c237351ed871 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.282715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, group_id=ee869eb8ed74447f924cb378bc4abb18, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.288427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.289975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a92ffc-2354-43ee-bb7a-21dfd284ffc7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.290732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.291242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.291726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.294085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.299313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.302996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 147/287] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:58 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:58.309182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:58.323004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd21ad-c3ee-44e2-8863-6676d3d39b2a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:58.334419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:58.335236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.335627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.336026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a/groups/ee869eb8ed74447f924cb378bc4abb18/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.339016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31c07f4cd41495289dd5ac774367d1a, group_id=ee869eb8ed74447f924cb378bc4abb18, role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:58.341924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d453497-bcb4-4dde-ac0d-155fa6f6ba03 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:58.412064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 141/288] 10.222.0.50 () {58 vars in 1463 bytes} [Wed Oct 12 12:22:58 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/groups/ee869eb8ed74447f924cb378bc4abb18/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:58.443512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 148/289] 10.222.0.50 () {58 vars in 1463 bytes} [Wed Oct 12 12:22:58 2022] PUT /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a/groups/ee869eb8ed74447f924cb378bc4abb18/roles/7bcc7d784f624412826cfb09306c7c53 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:22:58.803109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6989b4-7e51-4104-a801-615879888f9b None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.803388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6989b4-7e51-4104-a801-615879888f9b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.803667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6989b4-7e51-4104-a801-615879888f9b None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.805850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 142/290] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:22:58.811402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:58.811698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:58.811974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:58.835792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:22:58.837051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:22:58.921671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 149/291] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:22:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 12 12:22:59.452479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6989b4-7e51-4104-a801-615879888f9b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:59.469459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6989b4-7e51-4104-a801-615879888f9b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:59.474436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:59.475076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:59.475359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:59.475638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:59.494131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:22:59.499429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:22:59.500298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:22:59.501077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 143/292] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:22:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:22:59.508212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:59.518774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea509d-63a4-4dc2-ba63-0de9fa1accea None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:59.527550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:59.528171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:59.528459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:59.528736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:59.529441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:22:59.529748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:59.531363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:59.544274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 150/293] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:59.550003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:59.562303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759679d6-0d4a-478d-ae22-21de3795428e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:59.569522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:59.570167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:59.570448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:59.570759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] PATH_INFO: `/v3/groups/4304dd31c4eb439dab75d0b323999d6e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:59.583662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] RBAC: Authorizing `identity:get_group(group_id=4304dd31c4eb439dab75d0b323999d6e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:59.585570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:59.588129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 144/294] 10.222.0.50 () {56 vars in 1201 bytes} [Wed Oct 12 12:22:59 2022] GET /identity/v3/groups/4304dd31c4eb439dab75d0b323999d6e => generated 229 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:59.593602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:59.610173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db2b6-1ebb-46a0-a2a0-039fe39e5d73 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:59.617371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:59.618060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:59.618342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:59.618620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] PATH_INFO: `/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:59.621394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] RBAC: Authorizing `identity:get_project(project_id=4cf6bda1a6094b07a02029e1fb53aa49)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:59.623222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e588f99-44e4-4b41-91bd-196f2486e37d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:59.625258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 151/295] 10.222.0.50 () {56 vars in 1207 bytes} [Wed Oct 12 12:22:59 2022] GET /identity/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49 => generated 344 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:22:59.630782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:22:59.646743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7dfd4-3491-44a9-a345-eac966c0b26f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:22:59.652021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:22:59.652748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:22:59.653086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:22:59.653436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] PATH_INFO: `/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49/groups/4304dd31c4eb439dab75d0b323999d6e/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:22:59.655540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf6bda1a6094b07a02029e1fb53aa49, group_id=4304dd31c4eb439dab75d0b323999d6e, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:22:59.658532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65856cdf-5f1c-4242-8bec-b598c878fe91 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:22:59.774767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 145/296] 10.222.0.50 () {58 vars in 1463 bytes} [Wed Oct 12 12:22:59 2022] PUT /identity/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49/groups/4304dd31c4eb439dab75d0b323999d6e/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:00.032452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3dff-9e70-43ff-8e62-c5d5986adbb9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.033211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3dff-9e70-43ff-8e62-c5d5986adbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.033211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a3dff-9e70-43ff-8e62-c5d5986adbb9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.034785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 152/297] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:00.051187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5808f-e6ce-44e9-8cf7-62a62e40fce4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.051494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5808f-e6ce-44e9-8cf7-62a62e40fce4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.051729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c5808f-e6ce-44e9-8cf7-62a62e40fce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.078703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f5c5808f-e6ce-44e9-8cf7-62a62e40fce4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:00.079942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f5c5808f-e6ce-44e9-8cf7-62a62e40fce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:00.156191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:00.170585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 146/298] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:00.240527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24efa5-5725-4f12-a9e3-42491392dc21 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.240843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24efa5-5725-4f12-a9e3-42491392dc21 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.241086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24efa5-5725-4f12-a9e3-42491392dc21 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.242644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 153/299] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:00.248169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.248457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.248731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.273345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:00.275079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:00.367927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 147/300] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:00.516407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24efa5-5725-4f12-a9e3-42491392dc21 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:00.568794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:00.640559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24efa5-5725-4f12-a9e3-42491392dc21 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:00.685263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:00.685904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.686185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.686459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.699912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:00.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:00.706220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:00.706982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 154/301] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:00.714240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:00.728845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:00.888230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d99c6-593d-42bf-9045-686fbff77d13 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:00.897634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:00.952391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62311a-a266-4b53-b4ca-028571009213 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:00.967116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:00.967758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:00.968033 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:00.968302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:00.988640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:00.998676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:01.002935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:01.003809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:01.004615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:01.006477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 155/302] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:01.013843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.025823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.026565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.026847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.027117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.027810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] RBAC: Adding query filter params (name=member) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:01.028112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.029812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.044189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 148/303] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:23:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:01.050209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.147416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4dc74-3029-4f42-aa43-0cf8582102c2 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:01.214782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.215578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.215863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.216139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.216814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:01.217137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.219483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a76ccd-074e-49ef-8052-25cf7d8c37cd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.233785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 156/304] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:01.235451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec6be-06a5-4512-917d-bb37463b69b1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.235979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec6be-06a5-4512-917d-bb37463b69b1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.236477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ec6be-06a5-4512-917d-bb37463b69b1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.238398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 157/305] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:01.243941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce00403-4932-4abc-98c2-2a1e5a2f2004 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:01.245183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec6be-06a5-4512-917d-bb37463b69b1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.281972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.282642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.282922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.283191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.298661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.357503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.359848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.361208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152e212-f096-4975-ac83-07f82327c985 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.420113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ec6be-06a5-4512-917d-bb37463b69b1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:01.472317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.473203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.474359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.474742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.516839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 149/306] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:01.518171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383809-67c7-4db8-8811-739018521d07 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.518510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383809-67c7-4db8-8811-739018521d07 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.518874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3383809-67c7-4db8-8811-739018521d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.540328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b3383809-67c7-4db8-8811-739018521d07 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:01.541823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b3383809-67c7-4db8-8811-739018521d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:01.566675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.568405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7248ca-a475-49e0-ae47-54b6c3e92b41 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.599354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.630159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 150/307] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:01.631094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3383809-67c7-4db8-8811-739018521d07 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.645844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.700930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 158/308] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:01.702379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8809e-6e48-4a96-8ad1-c56ee1561f36 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.702668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8809e-6e48-4a96-8ad1-c56ee1561f36 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.702936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8809e-6e48-4a96-8ad1-c56ee1561f36 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.704399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 159/309] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:01.709166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8809e-6e48-4a96-8ad1-c56ee1561f36 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.766288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3383809-67c7-4db8-8811-739018521d07 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:01.807953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.808734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.809108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.809517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.813067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.814461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336b215-c247-47b9-ad95-49c19b986dfd None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.817160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 151/310] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:01.818834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.819215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.819602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.841455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:01.842780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:01.856717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8809e-6e48-4a96-8ad1-c56ee1561f36 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:01.889671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:01.901771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:01.904239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:01.904239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:01.904239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] PATH_INFO: `/v3/projects/a5ef5486653341d983d5e653a1c3ac07` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:01.905807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] RBAC: Authorizing `identity:get_project(project_id=a5ef5486653341d983d5e653a1c3ac07)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:01.907855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:01.910874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 160/311] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/projects/a5ef5486653341d983d5e653a1c3ac07 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:01.912235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.926739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 152/312] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:01.931284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:01.941006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.053477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2c50e-366d-4a1a-88f4-19f0553b0693 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.054769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43226302-2259-441d-b743-16d77b5e4b63 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.092368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.093063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.093383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.093665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.094799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.096325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.098268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 161/313] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.099281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.100203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.100914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.101222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.101501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.103011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.105661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.108629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 153/314] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Oct 12 12:23:01 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.109332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.176234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.202312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.217465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9996-25f4-4656-852e-7094c6b7be65 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.225228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77267a07-9628-4567-95b4-1215341fb7b4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.255264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.255918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.256202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.256546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.261832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.262445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.262775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.263048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.263774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] RBAC: Adding query filter params (group.id=ee869eb8ed74447f924cb378bc4abb18, role.id=6fb6c940635c427694cb507fd7126d0b, scope.project.id=a5ef5486653341d983d5e653a1c3ac07) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:02.264077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.265552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.270818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:02.271948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 154/315] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/role_assignments?group.id=ee869eb8ed74447f924cb378bc4abb18&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=6fb6c940635c427694cb507fd7126d0b => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.272844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:02.284313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:02.285292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:02.286094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:02.286676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 162/316] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:02.287561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.435065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cffc0-16aa-4cf1-bb23-289dbabcc6c4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.489166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c24c1-5db7-442f-b827-8e7d8db6005d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.490739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.493464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.493464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.493464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.494128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] RBAC: Adding query filter params (group.id=ee869eb8ed74447f924cb378bc4abb18, role.id=7bcc7d784f624412826cfb09306c7c53, scope.project.id=a5ef5486653341d983d5e653a1c3ac07) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:02.494455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.495952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.508964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 155/317] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/role_assignments?group.id=ee869eb8ed74447f924cb378bc4abb18&scope.project.id=a5ef5486653341d983d5e653a1c3ac07&role.id=7bcc7d784f624412826cfb09306c7c53 => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.509875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.530648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.532347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.550562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.551872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.552387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.553044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.568800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:02.574040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:02.580026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:02.581026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 163/318] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:02.585409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.667690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457eca5-f483-4e63-a1ec-0411aef835be None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.714533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.715302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.715589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.715869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.717644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:02.717958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.720055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801f6db-d94f-452f-abc8-e68aa705268f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.730186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eb73e-9f1c-47ee-a2ae-0d98db9a88a0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.732788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 156/319] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.734181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acc2f-aee6-4d78-b7d4-e24a5565f96c None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.734471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acc2f-aee6-4d78-b7d4-e24a5565f96c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.734746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4acc2f-aee6-4d78-b7d4-e24a5565f96c None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.736467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 157/320] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:02.739091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4acc2f-aee6-4d78-b7d4-e24a5565f96c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.775421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.776047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.776375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.776610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.777418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:02.777729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:02.779125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a0478-1455-4b6b-945d-10d4d0f2e8b9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:02.789020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 164/321] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:02.790848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.791137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.791413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:02.816585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:02.818117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:02.830567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.870168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:02.871956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4acc2f-aee6-4d78-b7d4-e24a5565f96c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:02.903192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 165/322] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:02.904114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:02.913984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:02.914641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:02.914923 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:02.915198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.007994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.010829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.023658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537aa16-7a8c-4a09-87ef-478239c4243a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.069367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.069984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.070267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.070542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.092222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.122827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.140809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 158/323] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:03.146591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.155289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.155289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.268276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9726698-182f-4ed3-afc7-23f47c2729a5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.278069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 166/324] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:03.279521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.308774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.309557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.309839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.310112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.311242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.312689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.317179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 159/325] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:03.317179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.357847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.378656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.408783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07744137-8504-49dc-8d3a-b58daeac7439 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.437665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ea655-251f-4fac-802a-f4c150d48a16 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.449439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.450095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.450379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.450657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.464107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:03.469014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:03.469930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:03.470726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:03.471324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 167/326] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:03.472052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.480865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.481557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.481831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.482108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] PATH_INFO: `/v3/projects/e31c07f4cd41495289dd5ac774367d1a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.483530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=e31c07f4cd41495289dd5ac774367d1a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.484690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.486403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 160/327] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/projects/e31c07f4cd41495289dd5ac774367d1a => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:03.487176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.597874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd80ae-fef3-4cb6-b194-6ab61aa9aaa1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.607731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8fca37-db02-4f46-bac6-7e1cff2c5ab5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.610233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.636002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.636633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.636913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.637215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.638320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.639742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.641338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 168/328] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:03.642180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.644806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.648022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.648640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.648951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.649278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.649952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:03.650259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.651635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.659930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 161/329] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:03.660711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.742072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329f460-58aa-426d-8ce9-c041bccc31b8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.759525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff8263-15b0-4bf9-ad95-03d15f061356 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.774806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.775440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.775723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.776002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] PATH_INFO: `/v3/groups/ee869eb8ed74447f924cb378bc4abb18` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.777099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] RBAC: Authorizing `identity:get_group(group_id=ee869eb8ed74447f924cb378bc4abb18)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.778576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.780320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 169/330] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/groups/ee869eb8ed74447f924cb378bc4abb18 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:03.780905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.797944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.798556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.798842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.799119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.799845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] RBAC: Adding query filter params (group.id=ee869eb8ed74447f924cb378bc4abb18, role.id=7bcc7d784f624412826cfb09306c7c53, scope.project.id=e31c07f4cd41495289dd5ac774367d1a) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:03.800158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.801629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:03.807814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 162/331] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/role_assignments?group.id=ee869eb8ed74447f924cb378bc4abb18&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=7bcc7d784f624412826cfb09306c7c53 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:03.810296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:03.853698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.864047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:03.887960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f0ed0-38de-4614-ac3f-eb88cd91fba7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.927987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.928610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.928887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.929188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.947637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64366d4f-7885-4e32-b4eb-385dc694ace8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:03.989256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:03.989875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:03.990175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:03.990542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:03.991278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] RBAC: Adding query filter params (group.id=ee869eb8ed74447f924cb378bc4abb18, role.id=6fb6c940635c427694cb507fd7126d0b, scope.project.id=e31c07f4cd41495289dd5ac774367d1a) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:03.991594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:03.993072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:04.003110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 163/332] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/role_assignments?group.id=ee869eb8ed74447f924cb378bc4abb18&scope.project.id=e31c07f4cd41495289dd5ac774367d1a&role.id=6fb6c940635c427694cb507fd7126d0b => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:04.007771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:04.009369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:04.094558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:04.128607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 170/333] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:04.134235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:04.231700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:04.239056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41a1960-f10f-4d95-8c4e-0bcf9ebe9c6b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:04.273649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:04.274791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:04.275068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:04.275365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] PATH_INFO: `/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:04.276484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] RBAC: Authorizing `identity:get_project(project_id=4cf6bda1a6094b07a02029e1fb53aa49)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:04.278016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:04.279643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 164/334] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:23:04 2022] GET /identity/v3/projects/4cf6bda1a6094b07a02029e1fb53aa49 => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:04.285328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:04.391445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4e482-2300-45d0-8aad-16a6912a0bd8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:04.425819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:04.426449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:04.426725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:04.426996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] PATH_INFO: `/v3/groups/4304dd31c4eb439dab75d0b323999d6e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:04.428097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] RBAC: Authorizing `identity:get_group(group_id=4304dd31c4eb439dab75d0b323999d6e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:04.429573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82ac40-e2c3-4b0f-8480-474327afd999 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:04.431340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 171/335] 10.222.0.50 () {56 vars in 1180 bytes} [Wed Oct 12 12:23:04 2022] GET /identity/v3/groups/4304dd31c4eb439dab75d0b323999d6e => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:04.437168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:04.536149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c17a0-c31e-4466-a093-0f5e74480613 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:04.568737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:04.569363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:04.569642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:04.569915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:04.571157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] RBAC: Adding query filter params (group.id=4304dd31c4eb439dab75d0b323999d6e, role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=4cf6bda1a6094b07a02029e1fb53aa49) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:04.571467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:04.572883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36710623-39cc-4dd3-9d1c-89c49de7c5b0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:04.578427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 165/336] 10.222.0.50 () {56 vars in 1376 bytes} [Wed Oct 12 12:23:04 2022] GET /identity/v3/role_assignments?group.id=4304dd31c4eb439dab75d0b323999d6e&scope.project.id=4cf6bda1a6094b07a02029e1fb53aa49&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:07.052185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da80a-c73b-43be-828f-e17b3bb1fcde None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.052726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da80a-c73b-43be-828f-e17b3bb1fcde None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.052726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866da80a-c73b-43be-828f-e17b3bb1fcde None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.054416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 172/337] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:07.059825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425cfc-32fc-4e86-90c6-1d7b8c3f32d1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.060209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425cfc-32fc-4e86-90c6-1d7b8c3f32d1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.060385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68425cfc-32fc-4e86-90c6-1d7b8c3f32d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.086472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-68425cfc-32fc-4e86-90c6-1d7b8c3f32d1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:07.087740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-68425cfc-32fc-4e86-90c6-1d7b8c3f32d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:07.114114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:07.176241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 166/338] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:07.235196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190263a-0ff5-4420-a3d7-3fb1415ced10 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.235839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190263a-0ff5-4420-a3d7-3fb1415ced10 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.236311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190263a-0ff5-4420-a3d7-3fb1415ced10 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.237956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 173/339] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:07.243924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.244437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.244939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.264223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:07.265759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:07.335993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 167/340] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:07.563285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190263a-0ff5-4420-a3d7-3fb1415ced10 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:07.609831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:07.674899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1190263a-0ff5-4420-a3d7-3fb1415ced10 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:07.689763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:07.737102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:07.737790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.738077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.738358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.760473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:07.761975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:07.792436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:07.793455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:07.794285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:07.794285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:07.794285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:07.801805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 174/341] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:07.807604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:07.853014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:07.871583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbda8bf-d0fa-4427-9bbc-aa4d9dec20fb None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:07.910401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:07.911404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.911880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.912365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.923758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:07.925534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-27505ec0-0852-4ed9-9e9b-5717ca0aa50e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:07.940888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:07.941808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:07.942659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:07.942659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:07.942659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:07.942816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:07.945047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 168/342] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:07.946684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a100-a902-4953-906c-c23e760c6c5f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:07.947164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a100-a902-4953-906c-c23e760c6c5f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:07.947736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237a100-a902-4953-906c-c23e760c6c5f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:07.949498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 169/343] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:07.950990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a100-a902-4953-906c-c23e760c6c5f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:07.960398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55cf3f-d694-4e89-b6e8-cc1e44d5dade None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.000062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.000675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.000962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.001267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.001910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:08.002214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.003599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed577a5-7bf2-4cb9-b45e-eb98d1c8c4fc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.016303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 175/344] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:08.022059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.022417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.022771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.043025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:08.044472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:08.065450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237a100-a902-4953-906c-c23e760c6c5f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.102928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.103523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.103826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.104108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.104708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:08.105150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.106416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fc73a5-e96d-4f1e-9f29-1880eb9091a1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.113445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:08.118616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 170/345] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:08.124051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d137ca-94eb-4b03-a3d1-b0ad62aedae3 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.124279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d137ca-94eb-4b03-a3d1-b0ad62aedae3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.124553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d137ca-94eb-4b03-a3d1-b0ad62aedae3 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.125401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 176/346] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:08.130266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 171/347] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:08.130373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:08.130464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d137ca-94eb-4b03-a3d1-b0ad62aedae3 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:08.226753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:08.246230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689627f-97f3-43cf-97ae-7a7b7d70009b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.251584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d137ca-94eb-4b03-a3d1-b0ad62aedae3 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.283149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.283763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.284288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.284288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.284948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.286512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044b58c-50e9-46a7-a2c2-8b97d7f2e562 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.292663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.293597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.294071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.294529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.295540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.298109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.393558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 177/348] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/users => generated 246 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:08.394803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.395093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.395365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.415852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:08.417090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:08.429219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 172/349] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:08.430450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:08.525560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:08.552134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 178/350] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:08.609323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c552c8-8da0-4af9-b30c-1763ac34cfb4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.655657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.656225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.656507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.656778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.668660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.670191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-f76da816-3e2e-43bc-9a1c-2f48487d007b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:08.686278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:08.687222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:08.688445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:08.688445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:08.688445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:08.688445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 173/351] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:08.694390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:08.779218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:08.824881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52569ffb-81ed-4f97-b315-4ae0e25b48ee None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:08.859946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2b13-50dd-40f1-b025-60a1ec8af96c None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.860282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2b13-50dd-40f1-b025-60a1ec8af96c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.860502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b2b13-50dd-40f1-b025-60a1ec8af96c None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.862132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 174/352] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:08.869971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.870362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.870747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.871862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:08.872489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:08.872768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:08.873037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:08.873715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:08.874013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:08.875376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:08.888889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 179/353] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:08.889900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:08.900933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:08.902967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:08.994957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 175/354] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:09.001260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.030951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650341c-050f-40ad-9f3c-9eae57a7ed3e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.062486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.088868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.105138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.106042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.106456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.106862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.125218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.125218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:09.141842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:09.143209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:09.144507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:09.144507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:09.144507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.144507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 180/355] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:09.151389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.199089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa4ccf-4852-4c7f-900e-d9fbc23b2fb5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.240843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.241848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.242349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.243360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.244568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.247792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.302115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b83050-ad00-436c-8a41-823b6f5f0fe0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.340348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.341007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.341323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.341594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.342233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:09.342536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.343898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.356532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 181/356] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:09.361172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.377197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 176/357] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:08 2022] POST /identity/v3/users => generated 248 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:09.379052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.447376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.579670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.580931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616df2fe-ed6b-4e6e-bf10-7a93a0ff3c34 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.590118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76e6a8-9f06-48bd-91de-cd990b849d36 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.627793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.628576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.628863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.629486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.630440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.631827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.634053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.634713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.634993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.640765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.640765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:09.640765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:09.690524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.sql.core [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:23:09.690524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 12:23:09.690524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [parameters: {'id': '8af5459e2ce54045a62dafc4db85d98b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 12:23:09.690524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81527) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:23:09.707798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return ref.to_dict() Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:23:09.708821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application yield resource Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise self.value Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application session.commit() Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:23:09.710040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:23:09.711347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:23:09.712890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:23:09.713851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [parameters: {'id': '8af5459e2ce54045a62dafc4db85d98b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:09.721508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 12 12:23:09.722370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.723280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 182/358] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Oct 12 12:23:09 2022] POST /identity/v3/roles => generated 144 bytes in 352 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:09.723280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:09.745696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 177/359] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:09 2022] POST /identity/v3/users => generated 249 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:09.853590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ff1cc0-84e4-439b-adda-6d394e0b9e51 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:09.855338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:09.899047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:09.899686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:09.899963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:09.900229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:09.916414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-672a7af8-6373-4037-8e05-473efcd02e9b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:09.921297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:09.922173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:09.922971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 183/360] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:09.928585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:10.067244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e4d00-632b-4190-ac3a-1565c77df089 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:10.104075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:10.104615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:10.104896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:10.105197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:10.105863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:10.106166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:10.107528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa40a65-6538-49ef-bdc9-1022370143eb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:10.115394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 178/361] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:10.915266 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6732f1-d3f3-4af3-ac80-ca95d1fe9e9b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:10.915813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6732f1-d3f3-4af3-ac80-ca95d1fe9e9b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:10.915813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6732f1-d3f3-4af3-ac80-ca95d1fe9e9b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:10.917459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 184/362] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:10.922387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57998-d64d-444f-b770-a39f56b5ec70 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:10.922805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57998-d64d-444f-b770-a39f56b5ec70 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:10.922979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb57998-d64d-444f-b770-a39f56b5ec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:10.947601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3fb57998-d64d-444f-b770-a39f56b5ec70 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:10.948840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3fb57998-d64d-444f-b770-a39f56b5ec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:10.958601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:11.042980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 179/363] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:11.063554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cba25-3e2a-4104-994f-dcc1bdec7d49 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.063898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cba25-3e2a-4104-994f-dcc1bdec7d49 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.064100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59cba25-3e2a-4104-994f-dcc1bdec7d49 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.065492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 185/364] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:11.073298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.073591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.073866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.097081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:11.098298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:11.193434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 180/365] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:11.416844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cba25-3e2a-4104-994f-dcc1bdec7d49 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:11.515285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:11.563045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59cba25-3e2a-4104-994f-dcc1bdec7d49 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:11.597260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:11.617725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:11.618373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.622565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.622565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.638069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:11.647126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:11.648008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:11.649323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:11.649944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 186/366] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:11.652615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edb3149-1c8e-4737-961a-4bd07350b29e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:11.658020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:11.708167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:11.721541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:11.722255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.722544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.722823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.747548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:11.754462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:11.756495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:11.758504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 181/367] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:11.766554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:11.848847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e8e54-2172-4efc-a2ff-7cf495393e96 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:11.880365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc228-31a4-46e8-a751-01d812e80427 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:11.911255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:11.919531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:11.920612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:11.921780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.922552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:11.931330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.931330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.931330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:11.931330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:11.931330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:11.931935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:11.931935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:11.931935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:11.931935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:11.931935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:11.944495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 182/368] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:11.951378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 187/369] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:11.957956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:11.975001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.097961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.117462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e9771-bac3-45d0-9288-6722a0b55179 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.164446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.165720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.166614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.167380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.173042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3d6ba-6812-42b3-8579-4dd7f06abca3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.179495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.181772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ca7faff6-7129-426b-b890-372327c440ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:12.198791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:12.199855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:12.200745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:12.200745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:12.200745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:12.203001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 188/370] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:12.204455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878524-bb9b-4b16-b62a-2ba28818f384 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.204948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878524-bb9b-4b16-b62a-2ba28818f384 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.205447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4878524-bb9b-4b16-b62a-2ba28818f384 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.207152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 189/371] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:12.208207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4878524-bb9b-4b16-b62a-2ba28818f384 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.228845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.229353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.229636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.229908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.243269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.245444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-63c53ac1-16cd-4bb1-ab89-0f5dc8f6341c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:12.266449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:12.267408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:12.268228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:12.268228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:12.268228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:12.268228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 183/372] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:12.269167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.269167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.269167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.290429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:12.292632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:12.342335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.343767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4878524-bb9b-4b16-b62a-2ba28818f384 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.381360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 184/373] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:12.382361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.388394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.388989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.389310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.389585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.390234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:12.390803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.397600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.400745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.420144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 190/374] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:12.426160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.551955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef399d-a6b0-4e30-9fff-ef67eaff77d0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.616773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa6f7-b683-4357-91a9-64eeffc7b22c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.620108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.621006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.621506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.622001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.622862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:12.623382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.625470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d962311-6b61-4b34-aac5-c00f0dfc82f2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.650226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 185/375] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:12.654382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd69b-1844-4fcd-b7a9-aaf74fc9d0f6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.654667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd69b-1844-4fcd-b7a9-aaf74fc9d0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.654943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfd69b-1844-4fcd-b7a9-aaf74fc9d0f6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.656409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 186/376] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:12.658170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd69b-1844-4fcd-b7a9-aaf74fc9d0f6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.666993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.667634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.667963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.668244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.676441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.678124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c3c7c8e3-9c16-4f4a-80f7-bdb3bf058e02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:12.692450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:12.693699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:12.694611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:12.697214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 191/377] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:12.698477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.698997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.699288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.701995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.718308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:12.719524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:12.770416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfd69b-1844-4fcd-b7a9-aaf74fc9d0f6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.778640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.795630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 192/378] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:12.798165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.810911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.812738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.813243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.813744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.824105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:12.826261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:12.843399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:12.844385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:23:12.845265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:12.847268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 187/379] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:12.848461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:12.933872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcab0d-99c4-461b-b7cd-194e65cfec4d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.955727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:12.963491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd7a92-4aff-4b56-9173-e2d202092fdb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:12.970236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:12.970376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:12.970615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:12.970846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:12.982257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:12.986976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:12.987865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 193/380] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:12.990025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.002475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.003302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.003640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.003922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.004650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.004952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.006406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2068ba44-3583-441a-b5da-11f6d17e6776 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.040568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 188/381] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8861634-5f70-4e03-96fe-eda359c5cea9 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8861634-5f70-4e03-96fe-eda359c5cea9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8861634-5f70-4e03-96fe-eda359c5cea9 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 189/382] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:13.048911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8861634-5f70-4e03-96fe-eda359c5cea9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.099045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77aacd-ac71-443f-8ad8-630d50d7d313 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.132398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.133000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.133882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.134160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.134883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.135194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.136642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.153868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8861634-5f70-4e03-96fe-eda359c5cea9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.171791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 194/383] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Oct 12 12:23:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.172614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.190679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.191225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.191504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.191775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.192434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.192738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.194404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e8371-a9a4-4451-973a-a52049d87c94 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.202703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 190/384] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.203832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.204116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.204392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.221979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:13.223175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:13.232587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.274749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a362ea0-48e4-43f5-9825-dbe27dbaf869 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.277072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.289884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 191/385] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:13.290712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.309042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.309789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.310070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.310344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.325680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.327299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:13.344798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:13.345756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:13.346599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:13.346599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.346599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:13.346599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 195/386] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:13.346842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.413614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dec436-8b34-47ee-80dd-ed52f9feb8b6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.451449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.452149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.452531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.452763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f743890-bc51-4f99-bc51-55c55ea52fcd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.452989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.464425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:13.469391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:13.470409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:13.471382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:13.477597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 192/387] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:13.477597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.480194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.494688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.495474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.495757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.496298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.512101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.514514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:13.529331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:13.530243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:13.531101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:13.531101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.531101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:13.531101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 196/388] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:13.531308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.543841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.583382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee756-f93c-45be-85c0-2c4b35c4c4f0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.616429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.617053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.617357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.618282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.628496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.630087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.631127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb80fc5-bc99-4c93-a96f-9c7b880ebdd8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:13.644541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:13.645446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:13.646291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:13.646291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.646291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:13.646291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 193/389] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:13.646510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.668577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.669212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.669496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.669770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.670410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.670736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.672118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.684414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 197/390] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.684414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.705378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.748523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69b8b-7e4f-401e-874c-5c589ed4769a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.750154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.781994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.782557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6e71f5-ff9e-42c8-9399-4209aae021c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.782658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.782870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.783145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.783815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.784125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.785535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.793998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 194/391] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.798659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.820801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.821432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.821706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.821964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.822593 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.822886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.824241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.835483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 198/392] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.836093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.892527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef18cef-01c6-4190-886f-aa8dda8a7119 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.908946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.925722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.935294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.935294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.935294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.935518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a543966-7c78-4a6b-b46e-a1d4faffa0c7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:13.937017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.938553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:13.953561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:13.954606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:13.955739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:13.955739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:13.955739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:13.957720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 195/393] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:13.958523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:13.963982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:13.971563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:13.972179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:13.972488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:13.980461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:13.980461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:13.980461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:13.980461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:13.987131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 199/394] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:13.987919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.056907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5745c-47d3-4338-8750-5b575490469d None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.085484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd5f85-6269-41ac-8f3c-a37ad664603c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.091692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.092335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.092616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.092888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.099823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.101318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:14.112926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:14.113962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 196/395] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:14.119761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.122867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.123493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.123769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.124037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.134556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.136032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.147954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:14.151073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:14.152091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:14.157807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:14.157807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:14.157807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:14.157807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 200/396] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:14.157807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.203816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.223336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f07d832-c98a-4adf-9581-658fb5d963b6 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.258995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.259813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.260104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.260379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.267761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.268319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2c62c5-b61d-4485-b9d7-59acef9a9357 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.269269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:14.282306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:14.283194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:14.284881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 197/397] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:14.288974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.304718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.305386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.305666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.305939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.306583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:14.306889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.308265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.321311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 201/398] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:14.322172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.389209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.401361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89cd49f-efdf-407f-9aa1-b69a16bd8f07 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.433466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.436181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55caa92-a988-44c0-8b93-2e3394644b37 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.440983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.444011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.444011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.444011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.451373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.452906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:14.468537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:14.469457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:23:14.470401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:14.470951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 198/399] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:14.471317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.478141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.478686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.478963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.479230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.479949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:14.480275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.481815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.499573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 202/400] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:14.500357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.574391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481668e-5c3c-4b16-89b0-9436ac3717b7 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.601415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a03c78-1180-4bbf-bd4f-2cce5a5eccac None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.607939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.608543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.608821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.609095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.609793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:14.610102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.611481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.623532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 199/401] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:14.624299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.635402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.636003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.636279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.636545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.637253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:14.637555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.638976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.639484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.650161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 203/402] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:14.650161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.672730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.725464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116377d-468c-4dc6-a2c3-56deec50e1fb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.750834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881a3f7-1fb0-467d-8f09-945f041840d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.759138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.759736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.760012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.760277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.760907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.762379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.784064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.784659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.784941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.785244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.785957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:14.786262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.787686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:14.804512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 204/403] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:14.805920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.848808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 200/404] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:14 2022] POST /identity/v3/users => generated 247 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:14.848808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:14.896601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.919893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f770b-2a59-4987-9c76-2ee75d675496 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.920881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:14.961805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:14.962391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed7526-3210-40a3-a527-09ae58efb0dd None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:14.962733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:14.962733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:14.963046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:14.979804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=cbb7f8775d5e4224a18fc0dd7a5f53b4, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:14.981506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.005095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.005095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.005095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.005095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.011537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.013035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:15.025325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:15.026227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:15.027127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 201/405] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:15.027741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.058095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 205/406] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:14 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:15.058950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.150241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cfff74-d495-46d8-9959-59b2a9b62a15 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.186928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.199192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe10458-2edb-4bae-8054-752b10b6875a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.200408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.201751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.203176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.203612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/09aecc43a8ab487c8ecfe0673ab12534/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.223394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=09aecc43a8ab487c8ecfe0673ab12534, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.227077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.231771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.241171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.241654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.241933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.242892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.254238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.255947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:15.271425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:15.272361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:15.273566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:15.273566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:15.273566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:15.273566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 206/407] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:15.274513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.326272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 202/408] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:15 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/09aecc43a8ab487c8ecfe0673ab12534/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:15.327759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.464112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d2bd6-9f81-4423-9eb9-bb881da1de4f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.465775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25db461-fd09-46e2-9c30-7c5fd97ed5e2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.515965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.516514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.516796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.517109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.517983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:15.518289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.519795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.523394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.524781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.526254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.526704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.528248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:15.528753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.531313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.533384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 203/409] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:15.538296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.555212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 207/410] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:15.560511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.580830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.610610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.656128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d15916-e7ef-4f6b-9a0a-d6445598225d None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.683466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f23de3-6b03-44d1-9255-73b692068997 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.695597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.697091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.697538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.697938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.705707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.707486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:15.720573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:15.721620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:15.722678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:15.724793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.724970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 204/411] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:15.733186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.733186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.733186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.734569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.737378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.739648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:15.756744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:15.757730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:15.759183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:15.759183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:15.759183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:15.759183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 208/412] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:15.764602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:15.902453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.909326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80607c8-4b6c-48ba-8e1f-9fcb3e06067a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.919796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:15.937215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee36ff-3e65-4260-85db-5b572fa78d84 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:15.953613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:15.954492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:15.956813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:15.957329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:15.958216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:15.959483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:15.963407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:15.997097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 205/413] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:16.003976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:16.009273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:16.010022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:16.010311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:16.010586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:16.011387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:16.011664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:16.013182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:16.032466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 209/414] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:16.037095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:16.161754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48219161-0eec-46eb-a24c-f0ad2cbc34b0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:16.217449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:16.218251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:16.218538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:16.218817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/4a804dd78ed44695afad6616ac504d03/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:16.238656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2e8ab-64a2-48df-8d7e-bc41b9657293 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:16.240742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=4a804dd78ed44695afad6616ac504d03, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:16.242298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:16.281846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:16.282485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:16.282766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:16.283041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:16.290723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:16.292233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:16.304486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:16.305433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:16.306291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 210/415] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:16.319011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:16.343003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 206/416] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:16 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/4a804dd78ed44695afad6616ac504d03/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:16.344392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:16.465413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817813c-c1b8-4804-86db-d1cbbbaeb443 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:16.520333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:16.520957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:16.521254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:16.521522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:16.522228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:16.522531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:16.524534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a9fb8-8ca9-4dd4-ad1e-07fe1eb7f5e0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:16.541269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 211/417] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:16.547158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:16.556661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:16.660970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a394eb-22e0-4056-a187-d71e260aa4fb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:16.697328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:16.697988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:16.698263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:16.698532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/2757d3bd0a47405bbf3ea97ecb3cf93a/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:16.716116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=2757d3bd0a47405bbf3ea97ecb3cf93a, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:16.717523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5ef27-7b90-400c-86e6-6844798fee55 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:16.816857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 207/418] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:16 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/2757d3bd0a47405bbf3ea97ecb3cf93a/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:17.547774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0c1e-8c25-446b-8f33-bdc0129f4269 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.548293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0c1e-8c25-446b-8f33-bdc0129f4269 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.548293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e0c1e-8c25-446b-8f33-bdc0129f4269 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.550013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 212/419] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:17.555208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf559d-5e2e-44c6-90d5-ef5483e6a6e1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.555607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf559d-5e2e-44c6-90d5-ef5483e6a6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.555761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf559d-5e2e-44c6-90d5-ef5483e6a6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.580347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-89cf559d-5e2e-44c6-90d5-ef5483e6a6e1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:17.581594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-89cf559d-5e2e-44c6-90d5-ef5483e6a6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:17.636290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7108d1-5a28-4c6b-b066-36ca91c4bcc1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.636611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7108d1-5a28-4c6b-b066-36ca91c4bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.636834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7108d1-5a28-4c6b-b066-36ca91c4bcc1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.638334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 213/420] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:17.643460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca52f-f0f9-4d47-9f0a-584e3d09bd4b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.643975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca52f-f0f9-4d47-9f0a-584e3d09bd4b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.644447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ca52f-f0f9-4d47-9f0a-584e3d09bd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.648803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:17.672713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-735ca52f-f0f9-4d47-9f0a-584e3d09bd4b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:17.675630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-735ca52f-f0f9-4d47-9f0a-584e3d09bd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:17.688206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 208/421] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:17.754710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:17.762687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 214/422] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:17.920857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643507-f6c3-4516-8e07-5fb235cc5b54 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.921201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643507-f6c3-4516-8e07-5fb235cc5b54 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.921447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9643507-f6c3-4516-8e07-5fb235cc5b54 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.922812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 209/423] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:17.928144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:17.928438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:17.928714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:17.958135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:17.959357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:18.045538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 215/424] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:18.151746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9643507-f6c3-4516-8e07-5fb235cc5b54 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.190279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.263072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9643507-f6c3-4516-8e07-5fb235cc5b54 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.298031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.298676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.298959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.299230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.313147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:18.314918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:18.315806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:18.316582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 210/425] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:18.330562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.412217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e458228-8ef6-462c-8882-108c269e13cc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.427850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:18.458848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:18.465393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.467097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.467400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.467679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.480046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:18.485522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:18.486500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.487298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:18.490015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 216/426] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:18.491012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.504500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23c569-d4e3-49ee-acb1-52bee40877c9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.541464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.542107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.542335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.542603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.543261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:18.543562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:18.545147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:18.554354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 211/427] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:18.557754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.610124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f7a7-2803-4c35-924a-414f7a9af9ba None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.647721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.648809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.649370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.649907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.661384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:18.667375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:18.668239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:18.669065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:18.671676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 217/428] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:18.672336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cd301-d7ca-4cf2-9f16-d0094e6b33c0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.672877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.688747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:18.717624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.718163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.718908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.719538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.720689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:18.720993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:18.722848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:18.732697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 212/429] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:18.737737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.739414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:18.808011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab0b8a-ac70-41bf-875b-0387e23bfa43 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.864440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.865075 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.865392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.865664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.870942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a5b9d1-9963-452e-8b90-f964effd1ee5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:18.880198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:18.882520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:18.903537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:18.904492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:18.905339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:18.905339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:18.905339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:18.911224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 218/430] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:18.911224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.917308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:18.918193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:18.918681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:18.919172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:18.920027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:18.920549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:18.922341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:18.933445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 213/431] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:18.934526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:18.968382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.018183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32a6ac-083e-45e3-9beb-de52d1deb986 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.019713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.046767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094da2b5-05a2-495f-9b64-8a0955cf6ab3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.053179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.053870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.054503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.054994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.066681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.068136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.082776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.083383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.083660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4b8eb74a-208f-4985-8533-7505e66d50c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:19.083825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.084686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:19.086157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:19.086157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:19.086157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:19.086339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.086339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:19.086339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.087056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 219/432] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.087056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ba78-3560-421d-bbe9-2ec6d77ceaba None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.087056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ba78-3560-421d-bbe9-2ec6d77ceaba None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.087234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330ba78-3560-421d-bbe9-2ec6d77ceaba None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.092736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 220/433] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:19.092736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330ba78-3560-421d-bbe9-2ec6d77ceaba None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.092916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.103891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 214/434] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:19.106226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.203066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.203997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0330ba78-3560-421d-bbe9-2ec6d77ceaba None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.213894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a664a65c-049c-4adb-b772-c4ce05991827 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.240234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.240793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.241071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.241374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.253194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.254673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.257630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.258368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.258654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.258930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.259589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:19.259894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.261316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-c8c39812-c582-40f0-9954-4915b9a9ff12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:19.269642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.270525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:19.271364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:19.271364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:19.271364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:19.271364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 221/435] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.272041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.272139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.272413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.276914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 215/436] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:19.277969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.289217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.295465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:19.296699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:19.371518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 222/437] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:19.372369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.394459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235817d-e25c-46c5-b5dd-227719be0b3b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.427315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.427940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.428219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.428489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.435730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.437202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:19.448847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.455678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 216/438] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.456604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.470359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.558292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca67877-5b79-4ecf-9788-206cd64ecf71 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.564226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e410ba-93e7-4804-b697-c8f85894cfbb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.594251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.594836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.595132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.595399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.596039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:19.596349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.597772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883a7e4-b304-4505-a7f4-3eb46675d045 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.600142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.600462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.601167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.601456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.601729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.608933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.614317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 223/439] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:19.615201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.615298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd4ee-6174-49b8-8095-92858e2ec465 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.615298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd4ee-6174-49b8-8095-92858e2ec465 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.615298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cd4ee-6174-49b8-8095-92858e2ec465 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.615298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 224/440] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:19.615298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd4ee-6174-49b8-8095-92858e2ec465 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:19.628924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.629983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 217/441] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.630853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.701779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.719264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cd4ee-6174-49b8-8095-92858e2ec465 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.731637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a8eff-c1e7-4450-8807-42fcf30f88e2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.752648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.753284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.753570 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.753842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.754560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:19.754927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.756287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4367516-4f2f-4421-bcc2-5fbe953811fc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.765489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.766115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.766392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.766660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.773421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 225/442] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:19.774566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:19.775124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.775405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.775677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.775971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:19.787261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.788333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 218/443] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.789267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.795663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:19.796772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:19.845918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.863134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 226/444] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:19.863947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.898595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26254f54-a7f2-41e9-90c2-2bee5cbfcdcb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:19.929779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:19.934802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:19.935437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:19.935724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:19.936054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:19.949153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:19.953864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:19.954743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:19.955594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 219/445] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:19.956810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:19.983403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0051c67-c612-470d-998d-62b83cb67a46 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.016590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.017232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.017520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.017795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.018513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:20.018818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.020255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.037680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 227/446] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:20.043470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.063856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defd4cd-92db-47e3-9c69-f9c1a28a9822 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.086134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.103383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.103951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.104245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.104502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.115902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.117397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:20.134147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:20.135081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:20.136218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:20.136218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.136218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:20.136218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 220/447] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:20.136218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.148505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef732360-5ba8-4e5a-896d-3e4efe8a2a64 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.180778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.182183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.182787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.183071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.183348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.184066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:20.184371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.185847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.203134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 228/448] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:20.203941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.235091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dac84-6f6b-4ddc-83cc-64067b66dd5d None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.267929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.268530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.268809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.269085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.269771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:20.270073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.271457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.279208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 221/449] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:20.283911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.302454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.305949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7391-b49d-4c05-9dd8-3b0f01ca955f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.340879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.341514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.341793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.342061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.383930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9f21d-b0b0-4bd2-a820-462b31ca5985 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.390714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.409025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.410519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.416648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.417305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.417582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.417853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.428048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:20.434120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:20.434981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:20.435936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 222/450] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:20.436810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.511431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.514949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 229/451] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:20.515760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.537309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf336b-a30d-4583-b022-9a34d73d61e5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.570792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.571418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.571662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.571935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.572575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:20.572881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.574291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.585637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 223/452] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:20.586912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.612958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.615699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17ef12-d7e6-41fe-bc55-9e89910642c3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.649691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.650228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.650508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.650781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.683737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa4470-f37e-4e3b-8a12-4db7b4075c58 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.715269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.717474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.718489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.719109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.719221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.719388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.719658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.730135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.731614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:20.745904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:20.746906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:20.747744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:20.747744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.747744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:20.747744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 224/453] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:20.747744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.816883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 230/454] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:20.817765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.825488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.846771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ca18b-731c-4b44-a548-b16709b1b676 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.879884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.880486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.880770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.881040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.881733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:20.882041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.883960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.891693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 225/455] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:20.892482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.914760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:20.917615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fbd78-5a9a-400d-961b-b41f2006359a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:20.951694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:20.952326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:20.952609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:20.952886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:20.963410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:20.964852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:20.979124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:20.980010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:20.980851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:20.980851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:20.980851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:20.980851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 231/456] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:20.981063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:20.997052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644733a1-feaa-4a85-a45b-488b86e890c8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.030505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.031121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.031424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.031700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.038107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.039552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.041991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:21.051118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:21.054549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 226/457] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:21.055433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.080131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f23cc7-3a7e-4b95-bd2a-9e6084c86b93 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.113279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.113880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.114159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.114435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.115061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.115356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.116712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.128500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 232/458] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.129323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.144493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.150838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabef0c-7e9d-49c3-90ba-cdf4de5f573c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.183859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.184405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.184681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.184952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.195307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.196776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:21.212133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:21.213247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:21.214267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:21.214267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:21.214267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:21.214267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 227/459] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:21.214494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.233963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf477598-c845-4479-8cdf-02f3457064d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.264867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.267449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.268153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.268435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.268709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.279812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.281314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:21.297291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:21.298349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:21.299179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:21.299179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:21.299179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:21.299179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 233/460] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:21.299179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.312513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d943aa-6c8d-417a-b5a7-ec27271a6487 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.349251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.349973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.350243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.350511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.357241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.357241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.357241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.363755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.369340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 228/461] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.369340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.402008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07198c73-8b22-4c02-a7f2-4a1f7827782c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.435765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.436297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.436580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.436855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.437564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.437972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.439416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.451872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 234/462] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.452903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.472243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c409a-70ae-4b9e-9c22-4ee89a4cb40c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.485795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.505896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.506652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.506942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.507212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.514459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.516298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:21.528464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:21.529560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:21.530620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 229/463] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:21.531260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.556125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed29522-fe44-4970-830c-17a7e302485b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.580478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.591509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.602911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.606185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 235/464] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.607150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.635737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c2ff9-f3f0-4071-95d8-17e363b9ec14 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.669921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.670521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.670795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.671064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.671699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.671995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.673385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.684784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 230/465] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.685582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.706754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a768c67-b4e2-4879-85cb-92432c93628f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.718404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.740182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.740812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.741092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.741396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.748194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.749675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:21.761417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:21.762416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:21.763384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:21.767361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 236/466] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:21.767967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.785734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a68821-be2c-4ecb-9d00-86acf281cc24 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.813112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:21.820086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.820739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.821561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.821833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/ddc59606d2aa4ce7aa86f25d905b9e6d/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.835913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=ddc59606d2aa4ce7aa86f25d905b9e6d, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.838363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.867089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df82bb-76d6-4a57-aacc-6e866bf74904 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:21.900734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:21.901662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:21.901972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:21.902216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:21.902941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:21.903245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:21.904664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:21.907165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 231/467] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:21 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/ddc59606d2aa4ce7aa86f25d905b9e6d/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:21.907984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:21.927863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 237/468] 10.222.0.50 () {56 vars in 1137 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:21.928692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.000327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.021302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26a948-41e1-4545-a8f3-8e5e0ca4d34e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.047569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9945c3-6973-463e-b4f8-6ea079527326 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.049461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.061575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.062234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.062509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.062782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.070725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.072837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:22.085549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:22.086447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:22.087278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:22.088985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 232/469] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:22.089803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.093921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.094802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.095088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.095360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.103387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.104870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:22.116452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:22.117427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:22.118881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 238/470] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:22.120614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.204031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b46ad-25dc-4ea0-a79c-5bdea578205f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.237388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee042f0e-7b97-47ac-b3a5-e8b3abff194e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.242621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.243763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.244042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.244306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.244998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:22.245324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.246771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.259708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 233/471] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:22.260373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.263208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.279348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.279961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.280241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.280513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.313008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.356139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.357644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.375008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c215228-5ba9-4277-a05e-be886da7bb36 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.413326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.413899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.414182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.414458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.415690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:22.416000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.417675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.429833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 234/472] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:22.430978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.477741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 239/473] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:22.478788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.504536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.542698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.552914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64027d3f-b8cc-4527-94bb-1bae87015016 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.584096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df24cf-5215-459a-b584-940ddc39a60f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.589808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.590421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.590699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.590973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.591702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:22.592004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.593468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.616921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 235/474] 10.222.0.50 () {56 vars in 1139 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:22.618421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.620687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.621457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.621738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.622717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.622717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:22.623024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.624448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.637181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 240/475] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/role_assignments?user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:22.637181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.744310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e3cc4-58bf-4773-b260-4b2099174e50 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.771658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.780288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909d89b-8ea6-4bf0-b86a-e03b9a159dc0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:22.790811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.791695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.792074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.792445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.793498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=09aecc43a8ab487c8ecfe0673ab12534) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:22.793851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.795646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.803668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 236/476] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/role_assignments?user.id=09aecc43a8ab487c8ecfe0673ab12534&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:22.804693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.820890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:22.833304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:22.834393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:22.834841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:22.835279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:22.851254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:22.854516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:22.875192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:22.876158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:22.877005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:22.877005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:22.877005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:22.883409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 241/477] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:22.884868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:22.963377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed4445-fabf-4433-83bd-d35a91adef25 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.003752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.004709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.005234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.005745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.010609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5373b-a3ef-41d4-bef2-fe62ccb9788e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.053215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.053736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.054023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.054334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.055098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:23.055557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.056941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.071573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 242/478] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:23.076122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:23.078032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.095896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.097579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.125403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:23.204241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54142409-ec89-443a-8b72-bd3bc5ece315 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.220862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 237/479] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:23.226672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.252299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.252942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.253581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.253861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.264170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.265800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:23.279444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:23.280490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:23.281632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 243/480] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:23.286158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.333110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:23.356586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb345-ca41-4c2c-b934-4386be15cc7c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.401981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.403053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.403427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.403709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.417100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d335a84-ebfc-47c0-8f54-dbf53c36f2da None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.417391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.418971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:23.419557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:23.442480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:23.443695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:23.444538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:23.444538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:23.444538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:23.445216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 238/481] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:23.452824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.461369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.462631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.462985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.463331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.464645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:23.465025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.467059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.489391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 244/482] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:23.498108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.578077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bcf28-a71c-40a8-816b-e2d918d6860a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.615721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.616349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.616633 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.616914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.617612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:23.618688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.620081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.622739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:23.634508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 239/483] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:23.649068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.680715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f680fd0-c69c-47c4-8860-d345d0f5e12a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.745083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.745719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.746000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.746274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.747008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=4a804dd78ed44695afad6616ac504d03) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:23.747317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.748771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.755216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 245/484] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/role_assignments?user.id=4a804dd78ed44695afad6616ac504d03&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:23.802985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641dfd-9470-4418-a1d0-166d139d9163 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:23.841639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:23.842289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:23.842569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:23.842841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:23.850428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:23.851924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:23.864676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:23.865596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:23.866483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 240/485] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:23.873881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:23.927462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:24.043870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14557832-3cfa-4fa5-805b-db39ff7c57aa None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:24.080392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:24.081006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:24.081317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:24.081774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:24.082482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:24.082790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:24.084239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc49ef4-8531-4720-a7e4-8c84ae4d1881 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:24.098629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 246/486] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:24.105008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:24.196892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:24.254679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a700ff-2cf1-448a-8451-c45ba68eead7 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:24.285801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28396a5-c574-44d6-994c-bb16bb5edfaa None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:24.286179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28396a5-c574-44d6-994c-bb16bb5edfaa None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:24.286525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28396a5-c574-44d6-994c-bb16bb5edfaa None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:24.288078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 247/487] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:24.294740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:24.294740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:24.294740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:24.309189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:24.310040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:24.310405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:24.310773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:24.311700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=2757d3bd0a47405bbf3ea97ecb3cf93a) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:24.312107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:24.316194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:24.320356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:24.321950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:24.325372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 241/488] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:24 2022] GET /identity/v3/role_assignments?user.id=2757d3bd0a47405bbf3ea97ecb3cf93a&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:24.413555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 248/489] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 12 12:23:24.690733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:24.798924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe3af3-c40d-47d0-aa5f-95fa2424b0ef None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:24.821695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:24.840767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:24.841446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:24.841724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:24.841995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:24.859026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:24.863816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:24.864688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:24.865508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 242/490] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:24.872902 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:24.893527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:25.006830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e394dc55-e3ff-49d3-8816-8a8133c61703 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.053590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.054204 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.054488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.054760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.055975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:25.056283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:25.057693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:25.073485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 249/491] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:25.079136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.203840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba44508c-5da9-42f0-a5dd-16f4e2f3a11b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.243556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.244619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.245151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.245643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.257092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:25.259977 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-63ff2dbe-5d28-4d47-b011-e24f5b161fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:25.274884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:25.275951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:25.276799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:25.276799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:25.276799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:25.278829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 243/492] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:25.284711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.326052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a570-8477-4756-b3cf-69d78f86caf5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.326052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a570-8477-4756-b3cf-69d78f86caf5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.326052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7a570-8477-4756-b3cf-69d78f86caf5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.326376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 244/493] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:25.331144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.331349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.331579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.350292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:25.351440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:25.380752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:25.383173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:25.410376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51eb376-2c13-4117-aa66-242cb3c1ff1a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.424150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 245/494] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:25.448884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.449623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.449909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.450183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.450885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:25.451192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:25.452606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:25.471257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 250/495] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:25.472481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.592471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7727ce0-4ee3-454c-9859-00d5fe8aef6d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.627969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.628661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.628944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.629249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.637010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:25.638497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:25.655790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:25.656843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:25.657789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 246/496] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:25.663083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.736964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.763464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:25.772043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2d26-dd93-459a-b6db-fd3fb37d2fd7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.813387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.814024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.814365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.814649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:25.815538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:25.815855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:25.817489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:25.821473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:25.839655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 251/497] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:25.846074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:25.944107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f0e644-70d8-457c-b170-2f491fda3e27 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:25.990191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:25.991102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:25.991387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:25.991666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.001815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8f06e-9339-4997-bf2d-7f987f909936 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.006208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-46fbdaa8-4a7f-4436-9b1b-4e0f676db4e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:26.012032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:26.012929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:26.013775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:26.014393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 247/498] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:26.015300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0135-c18e-4d66-aece-e2a59edb2979 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.015644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0135-c18e-4d66-aece-e2a59edb2979 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.015961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f0135-c18e-4d66-aece-e2a59edb2979 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.018233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 248/499] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:26.020599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0135-c18e-4d66-aece-e2a59edb2979 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.055741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.056349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.056624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.056893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.122131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.122676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.133940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.135589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.145189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f0135-c18e-4d66-aece-e2a59edb2979 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.188127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.188951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.189360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.189783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.191014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:26.191427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.193290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925fdc6b-cd49-45a2-84b8-429742d34d3b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.208947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 249/500] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:26.208947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.208947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.208947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.227152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:26.228784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:26.249756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 252/501] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 12 12:23:26.250975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.321531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 250/502] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:26.322778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.378267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.398613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a907f0b3-4ad2-47ab-8a77-94576e7460b3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.458072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.466340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.471825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.471825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.471825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.485548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.487013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:26.510648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:26.511649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:26.512549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:26.512549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.512549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:26.512549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 253/503] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:26.513670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ee0f1-2bea-4bf6-a8f8-240eb959ed62 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.525597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.562714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.563351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.563632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.563907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.576543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.578079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:26.593963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:26.594992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:26.595979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:26.595979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.595979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:26.595979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 251/504] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:26.605270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.705726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1fec28-e97b-4cd1-ace8-77eb7f9cdd20 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.739854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.740838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.741290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.741566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.742318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:26.742521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.744435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.746801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af4a5-8d6f-4e47-b237-e5b9097be40b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.756612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 254/505] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:26.757630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.761982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.779071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:26.788968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.789635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.789924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.790222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.790847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:26.791175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.792612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117180a-2dd2-4858-8b02-52cb549225ae None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 252/506] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827acf-b208-499f-a3f1-9beac7f21767 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827acf-b208-499f-a3f1-9beac7f21767 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4827acf-b208-499f-a3f1-9beac7f21767 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 253/507] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:26.812122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827acf-b208-499f-a3f1-9beac7f21767 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.877275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ede0a98-4d86-4c72-8fb5-20f16e672b00 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.912443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.913067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.913374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.913648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.924141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4827acf-b208-499f-a3f1-9beac7f21767 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:26.924584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.926094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:26.941540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:26.942522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:26.943660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:26.943660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:26.943660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:26.943660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 255/508] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:26.943660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:26.965846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:26.967133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.967822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.968277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:26.976840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:26.979082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-5aa1ab36-498f-46e6-8f68-f06dbe645c4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:26.990767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:26.991684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:26.992590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 254/509] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:26.994628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:26.994628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:26.994628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.012025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.012517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:27.013731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:27.055334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876b594-6536-4f9b-9d88-a7d6565d5ee5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.059279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.093517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 255/510] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:27.093517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.100856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.101555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.101838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.103294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.114592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.116165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:27.133005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:27.134166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:27.135154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 256/511] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:27.135635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.207665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676315f8-87f7-424d-bfc7-4f6a94c173ce None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.243300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.243837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.244120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.244396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.245037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:27.245376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.246753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.249191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69042c69-5343-49ab-b9b0-db3fe4d1176f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.259358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 256/512] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:27.260734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.266154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.284377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.284982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.285297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.285568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.286293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:27.286600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.288021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e169a958-eee2-4ee4-94a0-2c3f720e544d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.303304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.310833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 257/513] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:27.310833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89035a6-442f-4956-8487-123ea89e36a1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.310833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89035a6-442f-4956-8487-123ea89e36a1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.310833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89035a6-442f-4956-8487-123ea89e36a1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.310833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 258/514] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:27.316368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89035a6-442f-4956-8487-123ea89e36a1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.382172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153068ba-80da-4806-b155-14c6b22cf931 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.416247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.416852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.417150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.417438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.418125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:27.418432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.419862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.420854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89035a6-442f-4956-8487-123ea89e36a1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.431047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 257/515] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:27.431839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.454659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.455263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.455542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.455870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.456519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.457978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d62b5-eccf-48d2-871b-9e5d31d59d87 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.528119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.533769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c15208-dc86-43bc-9180-1de2f230b600 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.558836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 259/516] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:23:27 2022] POST /identity/v3/users => generated 254 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:27.560061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.560343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.560609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.567984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.568999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.569406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.569713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.580914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:27.585075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.585239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:27.585319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:27.600497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:27.601572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:27.603240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:27.603240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:27.603240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:27.603240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 258/517] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:27.603240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.615058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.667113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 260/518] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:27.668400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.741893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5dd856-3977-451f-acac-7da93364f6d4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.785070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.786057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.786539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.787047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.787811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.789414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.796635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a71d26-6635-4e12-81ff-7ff66e0fd843 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:27.805639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:27.806656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:27.807479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:27.810468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 259/519] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:27.811744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.829543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.840879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.841918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.845415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.845415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.845415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=ddc59606d2aa4ce7aa86f25d905b9e6d) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:27.845415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.846209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.854382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 261/520] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/role_assignments?user.id=ddc59606d2aa4ce7aa86f25d905b9e6d&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:27.855337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:27.897517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:27.931827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61948346-9105-49d8-93fc-cd9508c3432e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.970719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:27.971401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:27.971612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:27.971835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:27.972505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:27.972815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:27.974338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:27.983869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155140a-4f25-4eda-b45f-4e6feb8d6cdb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:27.987676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 260/521] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:27.988562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.026546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.028058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.028645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.029227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.030156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:28.030667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.032463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.038552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 262/522] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:28.040396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.077107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:28.113427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e832bf7-98af-4928-a316-f6646768b414 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.153814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.154045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.154136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.154625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] PATH_INFO: `/v3/services/network` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.155394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.156348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.163826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:28.171845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:28.177910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:28.178753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 261/523] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:27 2022] GET /identity/v3/services/network => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:28.179569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7e21a6-5fc9-4b70-8532-475e3d0287d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.179649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.222063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.222720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.222999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.223252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.234061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.235775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:28.251837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:28.253822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 263/524] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:28.255786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.301288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f44e4-f9fa-4d24-8c51-89e04467d26e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.339418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.340148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.340503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.340848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.341579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:28.341944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.343397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.347100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:28.356781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 262/525] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:28.360331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.409273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db56029-8efe-45d4-b083-8ea3783514ba None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.473704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.474587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.474871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.475146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.475795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:28.476099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.478519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.483895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 264/526] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:28.489631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.507271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:28.542134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f6ac1a-16b9-4a08-8f29-b33ff9d47a5b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.611804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.612419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.612694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.612961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.613692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:28.613994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.615518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.632720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 263/527] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:28.639453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:28.658759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba031c2-9213-4d6f-84e8-535c4643b3a6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.702257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.702999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.703374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.703744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.704468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:28.704864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.706702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee771-f520-46bf-9689-e3e76b85d4d7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.715050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:28.717315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 265/528] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:28.770213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1f2a2-16d7-464b-a846-0382b6e0f189 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:28.810931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:28.812084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:28.812570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:28.813044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:28.815347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=cbb7f8775d5e4224a18fc0dd7a5f53b4, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:28.817183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186dc409-089f-47af-9281-c5b67babab3e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:28.897067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 264/529] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:28 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:23:30.112115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79cc8-a55b-4955-84d6-83bab46493f7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:30.112635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79cc8-a55b-4955-84d6-83bab46493f7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:30.112712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e79cc8-a55b-4955-84d6-83bab46493f7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:30.114315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 266/530] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:30.130474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669fa3-531b-441f-9f77-a6e6fc0721b9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:30.130909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669fa3-531b-441f-9f77-a6e6fc0721b9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:30.131086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a669fa3-531b-441f-9f77-a6e6fc0721b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:30.163894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2a669fa3-531b-441f-9f77-a6e6fc0721b9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:30.165145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2a669fa3-531b-441f-9f77-a6e6fc0721b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:30.252403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 265/531] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:30.591125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23963-6fe6-49d2-8e16-12eb75be24c0 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:30.591486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23963-6fe6-49d2-8e16-12eb75be24c0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:30.591691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d23963-6fe6-49d2-8e16-12eb75be24c0 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:30.593308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 267/532] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:30.598369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:30.598656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:30.598932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:30.626021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:30.626340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23963-6fe6-49d2-8e16-12eb75be24c0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:30.627216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:30.692699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:30.734022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 266/533] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:30.764850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:30.795870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d23963-6fe6-49d2-8e16-12eb75be24c0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:30.840682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:30.841409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:30.841677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:30.841956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:30.862036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:30.867396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:30.868338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:30.869216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 268/534] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:30.874235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.002793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c210023-f9d8-4cbd-91d8-301e2294f3aa None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.006558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.044632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.045589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.046069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.046547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.047457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:31.047939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.052170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.065714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 267/535] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:31.074180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.151130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.221827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451fd68-8f7c-4208-a924-29d42322491f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.243704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75562a7-00e3-4c62-adcc-9a1f2623ec00 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.261836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.262809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.263328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.263783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.275769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.277684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-350c0673-b097-4a9f-999d-64767e984b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:31.293589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:31.294589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:31.295537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:31.295537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:31.295537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:31.297579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 268/536] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:31.303199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823610f-7eca-43a6-a9a0-b149febdfabf None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.303329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.303329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.303329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.303329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.304102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823610f-7eca-43a6-a9a0-b149febdfabf None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.304526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823610f-7eca-43a6-a9a0-b149febdfabf None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.306742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.307996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 269/537] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:31.308970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823610f-7eca-43a6-a9a0-b149febdfabf None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.322407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5ad6ab68-3798-46b6-bc83-bbaa9e1568a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:31.327772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:31.328689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:31.329594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 269/538] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:31.330499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.330676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.330962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.356020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:31.357273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:31.426536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 270/539] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:31.427307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.470750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.480345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823610f-7eca-43a6-a9a0-b149febdfabf None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.521711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.522601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.523028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.523447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.524324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:31.524841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.526579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9a71e-a2a3-4cf6-9a26-cd21712d08e4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.541298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 270/540] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:31.543078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7630-6bbe-471b-b3ca-648b52af7ae0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.543639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7630-6bbe-471b-b3ca-648b52af7ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.544118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c7630-6bbe-471b-b3ca-648b52af7ae0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.546111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 271/541] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:31.547202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7630-6bbe-471b-b3ca-648b52af7ae0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.565331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3febd7f-057e-4ead-8df6-85f97882c1d1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.601324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.616481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.617442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.618493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.618982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.619850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:31.620362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.622003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d449a-98a9-4e7f-abe4-af5aa7c65847 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.635283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 271/542] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:31.636874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.637395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.637892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.658029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:31.659223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:31.669554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c7630-6bbe-471b-b3ca-648b52af7ae0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.707146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.707687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.707971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.708292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.716172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.717655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.729318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 272/543] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:31.730018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-bdd4fc37-381e-4190-9c7e-df684138d425 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:31.730494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:31.731409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:31.732319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:31.736194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 272/544] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:31.737449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9269c2-781f-4f00-b8b0-9bb32125b500 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.737738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9269c2-781f-4f00-b8b0-9bb32125b500 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.738017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9269c2-781f-4f00-b8b0-9bb32125b500 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.739520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 273/545] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:31.740102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9269c2-781f-4f00-b8b0-9bb32125b500 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.755781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.840271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2852d-75cc-4783-8eb1-90fb874f648c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.846564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9269c2-781f-4f00-b8b0-9bb32125b500 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:31.859979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:31.876536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.877310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.883741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.883741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.883920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:31.883920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.883920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.883920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:31.884197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.885428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87004803-c634-4229-91a0-b90362b411c3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.888102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:31.889587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:31.904933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:31.907425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:31.908363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:31.908363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:31.908363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:31.908363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 273/546] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:31.908363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:31.985240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 274/547] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:31 2022] POST /identity/v3/services => generated 251 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:31.985240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:31.985240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:31.985240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.002358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:32.003613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:32.022037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a00981-ff62-48a8-a88f-d01f4e33a29d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.064706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.065350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.065632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.065905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.066638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:32.066949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.068392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.083670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 275/548] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 12 12:23:32.084852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.095740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.098826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 274/549] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Oct 12 12:23:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:32.099950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.129616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.233002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928509d-ee93-4f3d-ad51-16c51f117460 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.234599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8f57b-7588-4e0f-9e8b-db12f7eb2d74 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.273285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.273813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.274118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.274399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.275053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.276344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.276487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.277256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.277706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.278124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.278976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:32.279449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.281040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.294832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 276/550] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:32.295943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.356842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 275/551] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:32 2022] POST /identity/v3/services => generated 240 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:32.358754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.371193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.486437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398afd55-8926-4c01-ab3e-2a3c9ac2e792 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.516500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.549725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48d6117-e6dc-4630-89b1-e1e08d196853 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.553296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.554663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.555149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.555670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.569551 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.571769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:32.590693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:32.591692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:32.592707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:32.592707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:32.592707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:32.592707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 277/552] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:32.592707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.600789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.601465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.601744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.602016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.610367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.611587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:32.624581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:32.625612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:32.626579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 276/553] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:32.631377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.729881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbfcee1-cdac-40bb-952c-3c0d8f8873dc None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.745586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af573b-1f63-4579-9f54-807e9108e407 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.750533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.779942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.780770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.781176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.781586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.784378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.785343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.785823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.786288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.787131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:32.787744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.789411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.794115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:32.801598 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:32.801932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:32.802824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:32.803646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:32.808904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 278/554] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:32.809927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.812221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 277/555] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:32.816819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:32.932141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e060-fa58-4b10-a58b-7c0951ae09c8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.945811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254aaffd-1d12-423d-84ee-b6bfaea2c1f8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:32.976505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.977139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.977620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.977991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.978666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:32.978970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.980818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.989563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:32.990451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:32.990930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:32.991398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:32.992327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:32.992872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:32.994684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:32.995466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 278/556] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:32.996336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.017451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 279/557] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:33.018642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.054778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.080267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.128868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be54028d-8d02-424b-892a-7862f70178f9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.154298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f70f5-a3aa-4db1-a2f8-01d865447045 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.171731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.172595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.172942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.173311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.180441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.181952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:33.193396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:33.194561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:33.195459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:33.199949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 279/558] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:33.200897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.202059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.202997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.203480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.204203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.216649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.218143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:33.234721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:33.240760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:33.241896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:33.241896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:33.241896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:33.241896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 280/559] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:33.241896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.328537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.348603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3f8cf-489c-48a0-a7e7-6dc6e3e6c052 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.357034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a242d509-586f-4262-a340-62c76c2a2eae None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.385899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.386512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.386791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.387072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.387235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.387931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:33.388123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.389585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.400264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.401148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.407199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.407199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.407383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 281/560] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:33.407383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.418200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.419917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:33.435829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:33.436741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:33.437658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:33.437658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:33.437658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:33.444166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 280/561] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:33.445236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.507213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee50a1-4c53-456f-9319-c4720b06a03e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.542614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.543138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.543415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.543683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.544337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:33.544788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.546062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.553978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae53bf1-1e82-4421-9201-90933d87851a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.563186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 282/562] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:33.563186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.563186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.595904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.596905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.597432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.597927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/1ea7c1b7087545fabde10f0460530873/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.615218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=1ea7c1b7087545fabde10f0460530873, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.617012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.662796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508ca3-c593-4176-9811-a72685583733 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.693181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 281/563] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:33 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/1ea7c1b7087545fabde10f0460530873/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:33.693181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.720496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.721149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.721423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.721693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.722352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:33.722656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.724135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.748122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.751442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 283/564] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:33.757244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:33.867812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:33.904327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fc0045-97b2-434f-8e89-a6b0e04ba296 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.944340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a586f47-d5c6-4f41-9963-7f04e88f5d20 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:33.962574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.963210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.963495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.963995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.974526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:33.976173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:33.992199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:33.992906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:33.993218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:33.993492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:33.995008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:33.995926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:23:33.996878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:33.999079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 282/565] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:34.004501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.006577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.009709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:34.023911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:34.025442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:34.026334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 284/566] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:34.032090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.116670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:34.136299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f902f14-6102-4dab-910e-ce9dc10d03bb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:34.143122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd401b1c-7923-4b4d-ae9c-019d7418c646 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:34.168300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:34.179098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:34.180120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:34.183116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.183116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.183278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.183350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.183419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.183419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.183561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:34.183630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:34.183697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.183762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.183762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.184596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.196747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 285/567] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:34.202467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.204851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 283/568] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:34.211097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.310672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1585d-f793-49f6-a51a-f37de151272c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:34.320463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ccff9-73ec-4ca9-9e3b-02d412191137 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:34.358737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:34.364103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.364103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.364103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/ddc59606d2aa4ce7aa86f25d905b9e6d/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.364346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:34.364346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.364346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.364346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.364943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=ddc59606d2aa4ce7aa86f25d905b9e6d, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.364943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f03ede-9fc7-4dff-bfb2-042a3a109df4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.375172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:34.431035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.432396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.463709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 286/569] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:34 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/ddc59606d2aa4ce7aa86f25d905b9e6d/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:34.465369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a84d2-683d-42d7-b264-34d83e015f88 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.465828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a84d2-683d-42d7-b264-34d83e015f88 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.468210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a84d2-683d-42d7-b264-34d83e015f88 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.468687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 287/570] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:34.477188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844440-7bd5-40eb-ad12-36c1745c709f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.477188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844440-7bd5-40eb-ad12-36c1745c709f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.477188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3844440-7bd5-40eb-ad12-36c1745c709f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.516132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b3844440-7bd5-40eb-ad12-36c1745c709f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:34.517403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b3844440-7bd5-40eb-ad12-36c1745c709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:34.607788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:34.648327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 284/571] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:23:34.654828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.674954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 288/572] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:34.707097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909de9-833c-4573-b152-0440d4813ca2 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.707377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909de9-833c-4573-b152-0440d4813ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.707563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe909de9-833c-4573-b152-0440d4813ca2 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.709035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 289/573] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:34.714973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.715253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.715525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.725295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:34.735673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:34.737224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:34.801191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03451cf-7faa-430e-89b0-336d70b1a99a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:34.838340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:34.839221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:34.839500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:34.839768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:34.850775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 290/574] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:34.850954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:34.852292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:34.867080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:34.868629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:34.869562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:34.869562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:34.869562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:34.869562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 285/575] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:34.874120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:34.983879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.028865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f19cf-9a02-4274-87f5-807ee1cadb5c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.030991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.097426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.099314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.099943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.100224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.100497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.105282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.105282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.105282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.115038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a503-b499-4d84-9a67-f75e7549ef60 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.121323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 291/576] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.124958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.199824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.200476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.200847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.201050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.201718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.203233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:35.222562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:35.223641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:35.224466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.227855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 286/577] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Oct 12 12:23:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:35.228679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.253849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0702823b-4d07-49b4-86dc-aeefd53874c8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.304123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.304871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.305282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.306174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.314544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.316161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:35.333806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:35.334694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:35.335888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 292/578] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:35.336405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.361451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb059a9c-88c4-4d71-ba2d-11690724cbc5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.366428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.417512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.418326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.418671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.419007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.419975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.421691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:35.434652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:35.435750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:35.436666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 287/579] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:35.437512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.463940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d055a3-a5f5-4fee-8fe8-7da51501e8aa None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.469091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.503645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.504606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.505065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.505565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.506383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.506875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.508421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.513815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 293/580] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.514867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.572836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e77110-fd10-4c2c-98ec-5e1567012bc5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.605283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.625086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.626407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.626953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.627403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.628275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.628718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.628862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a5b424-8eb2-4e62-af4b-9e194c75dbba None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.630616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.648371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 288/581] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.650006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.667453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.668206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.668586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.668960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.669789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] RBAC: Adding query filter params (name=network) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.670191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.671825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.681223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 294/582] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.682362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.762442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:35.781989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665ded3-aa8e-4fab-9275-d19629fedafc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.798496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cb427a-ad1b-4844-9bfe-3fa44e67debc None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:35.825160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.826277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.827119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.827534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.828568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.829045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.831474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.843303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:35.843303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:35.843303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:35.843303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:35.843698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:35.843698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:35.843698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:35.844112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 289/583] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.845472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.850788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 295/584] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/role_assignments?user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:35.850935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:35.869072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.009508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e00416-380f-492a-89ef-6bfc6c25812a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.037581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21776a43-adf0-4115-887a-917e03c00ed1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.072617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.073572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.074883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.075324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.076271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] RBAC: Adding query filter params (interface=public, service_id=adcfac70af8a4ee98f02095731f9f547, region_id=RegionOne) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:36.077471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.079558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.088751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.089049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 296/585] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/endpoints?service_id=adcfac70af8a4ee98f02095731f9f547&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:36.089940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.090232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.090511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.091146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] RBAC: Adding query filter params (type=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:36.091451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.092932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.093982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:36.103186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 290/586] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:36.104434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:36.116628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.182287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.207710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd2c64-98f9-412a-9df7-de95d92f3371 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.215516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f956c31-e765-4f3f-b65f-87b1fc9233fa None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.248608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.249642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.250166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.250654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.251479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.252743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.253383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.253492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.253668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.253930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.254655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] RBAC: Adding query filter params (interface=public, service_id=1a8828b21acb45e3a34b56b9881a8ddf, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:36.254966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.256378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814c1f9-d2a5-47d3-8f61-d6319311b887 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.262046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 297/587] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:36 2022] GET /identity/v3/services => generated 772 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:36.269286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 291/588] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:36 2022] GET /identity/v3/endpoints?service_id=1a8828b21acb45e3a34b56b9881a8ddf&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:36.272044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:36.396918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372e32e-39de-40d9-a0c4-747e883fd0ee None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.409105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c9b7-0626-48ba-ac8b-4bdf904dae08 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.409430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c9b7-0626-48ba-ac8b-4bdf904dae08 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.409879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260c9b7-0626-48ba-ac8b-4bdf904dae08 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.415427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 292/589] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:36.417324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51c46-9ebb-4b5d-a8d4-19e0b77b2ee7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.417620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51c46-9ebb-4b5d-a8d4-19e0b77b2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.418174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51c46-9ebb-4b5d-a8d4-19e0b77b2ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.441153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ead51c46-9ebb-4b5d-a8d4-19e0b77b2ee7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:36.441153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ead51c46-9ebb-4b5d-a8d4-19e0b77b2ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:36.449916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:36.451623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.452152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.452639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.453939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:36.455548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:36.461992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 298/590] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:36 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:36.549308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 293/591] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:36.826231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:36.836999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.953053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859441d-53e3-4d22-954c-b8c5db245a26 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:36.970924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737b7b-90ce-4939-9098-2288d353bf73 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.971260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737b7b-90ce-4939-9098-2288d353bf73 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.971495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f737b7b-90ce-4939-9098-2288d353bf73 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.973105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 294/592] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:36.978924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:36.979205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:36.979482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:36.987172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:36.999018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:36.999963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.000392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:37.000636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.000893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.001201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.014959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:37.020932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:37.021889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:23:37.022709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:37.028389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 299/593] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:23:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:37.030540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.133542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 295/594] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:37.138219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:37.175523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76f110-215d-4d96-b259-a68b85552bb4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:37.213786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.214406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.214690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.214966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.215638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:37.215993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:37.217413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:37.230530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 300/595] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:37.233421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.340742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592df5ed-e0a9-42db-b022-ce95b8a54779 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:37.385006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.385587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.385872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.386151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.388064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:37.397411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:37.398920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:37.418915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:37.420300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:37.421683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:37.421683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:37.421683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:37.421683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 296/596] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:37.427970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.552237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.570805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8410d4-76bd-4672-82da-ae91a5fdaa75 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:37.601494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:37.608675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.609331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.609617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.609896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.610549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:37.610864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:37.612234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:37.629856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 301/597] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:37.630725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.744909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98973df8-c445-472c-8892-f00f2c414d3b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:37.781766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.782630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.782929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.783275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.790988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:37.792920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:37.805251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:37.806785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:37.807750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 302/598] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:37.812980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.831289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30f66e-d187-42f6-b7b1-75e6be4d9fe4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:37.894142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:37.894785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:37.895063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:37.895333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:37.907200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:37.918826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:37.928162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:37.929264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:37.930123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 297/599] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:37.938311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:37.996745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:37.998571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e888dce-bf20-4f84-90b4-9c3fef092b33 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.060493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a96116-4c20-48bd-91a9-73beb98c32e6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.079178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.079801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.080087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.080366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.081101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:38.081849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.083288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.114533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.115496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.115960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.116415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.118440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:38.118957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.120784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.124458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 303/600] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:38.128319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.146870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 298/601] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:38.165894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.250256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f6e44-db72-46f3-a807-13658da654cd None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.259269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.291769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.292810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.294124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.294823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.378604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0eac34-cce6-415f-9339-d1711c4e3166 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.388487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.415207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.416673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.436602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.437278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.437563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.437837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.464754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.466247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:38.496753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:38.497791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:38.498695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:38.498695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:38.498695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:38.498695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 299/602] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:38.503792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.545811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 304/603] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:23:38.551398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.560152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.659749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcfbf8-9fbb-472e-9965-ef0bec78e352 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.700221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.700857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.701148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.701431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.726182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.726957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d20db-02ad-46a3-b6b7-7d92a97251e4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.727686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:38.754442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:38.755403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:38.756263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:38.756263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:38.756263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:38.756263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 305/604] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:38.763211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.791617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.792231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.792513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.792787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.793464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:38.793767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.795154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:38.824101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 300/605] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:38.829965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:38.870332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.879044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:38.939347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f628-9e57-4c32-8503-413837119f52 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.987911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:38.988541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:38.988830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:38.988997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad531b-d7f6-44a9-b842-817229b7de1a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:38.989190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:38.989798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:38.990109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:38.992890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25869809-df65-484a-932b-18cc6dc79cb8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.013379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 306/606] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:39.014971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08450-b807-4a62-9e14-b57b390aa853 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.015258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08450-b807-4a62-9e14-b57b390aa853 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.015535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d08450-b807-4a62-9e14-b57b390aa853 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.016906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 307/607] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:39.019169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08450-b807-4a62-9e14-b57b390aa853 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.039565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.041060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.041541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.041969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.049753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.051677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-6b3a2bbb-42d1-4d30-880a-71e9f3ec3d30 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:39.065236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:39.066288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 12 12:23:39.067237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:39.071440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 301/608] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:23:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:39.072679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57689a2-9477-41c7-9612-c74d2074822d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.072972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57689a2-9477-41c7-9612-c74d2074822d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.073277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57689a2-9477-41c7-9612-c74d2074822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.091137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d57689a2-9477-41c7-9612-c74d2074822d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:39.092340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d57689a2-9477-41c7-9612-c74d2074822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:39.130318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d08450-b807-4a62-9e14-b57b390aa853 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.147860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.158660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 302/609] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:39.159901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fb19-3d0f-48c8-91c2-60e5fa9c1af0 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.166995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fb19-3d0f-48c8-91c2-60e5fa9c1af0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.166995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1fb19-3d0f-48c8-91c2-60e5fa9c1af0 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.166995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 303/610] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:39.166995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1fb19-3d0f-48c8-91c2-60e5fa9c1af0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.170630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.171265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.171546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.171811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.178642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.180147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.186284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9bc8e6ae-f2e3-4d74-be14-d39be724dec3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:39.192125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:39.192990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.194256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 308/611] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:39.195459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4751f6e-c3df-4df1-868d-198f9d27edff None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.195459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4751f6e-c3df-4df1-868d-198f9d27edff None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.195459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4751f6e-c3df-4df1-868d-198f9d27edff None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.200693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 309/612] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:39.205695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.205695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.205695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.221070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:39.222707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:39.291193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1fb19-3d0f-48c8-91c2-60e5fa9c1af0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.294729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 310/613] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:39.295563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.339679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.340768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.341246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.341801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.343001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:39.343751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.346073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9578cc5-4bbb-421e-8516-0a0612043c94 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.368460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 304/614] 10.222.0.50 () {56 vars in 1135 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:39.370064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.370485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.370888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.393461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:39.395099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:39.432285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61df655-bdf9-4a5a-90f7-cf31f96c03d0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.442485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.468975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.469829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.470106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.470539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.471541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:39.471907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.473320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.473817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.488165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 305/615] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:39.488165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.496012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 311/616] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:39.496863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.592079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d76f05-d052-4cfe-8680-831cbebeaf48 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.610610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39864001-2e4d-4c73-bf6b-2132dce2eb2c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.633693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.634541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.635221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.635494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.646443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.647421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.647707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.647980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.648871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.650309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:39.659742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:39.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.662044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 312/617] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:39.662837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.697379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.716540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.722029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.724093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.768784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc441e-f718-4de1-9465-c5057fc8ceb0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.803442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.804028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.804302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.804567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.805311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=1ea7c1b7087545fabde10f0460530873) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:39.806243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.807656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.813249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 313/618] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/role_assignments?user.id=1ea7c1b7087545fabde10f0460530873&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:39.814001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.840322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 306/619] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:23:39.842410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:39.921919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.928969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d3f36-29ea-4a04-b228-68db3211a6a5 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.953616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:39.957928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213a14c-6880-47d9-861e-baf7303e6842 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:39.968988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:39.969678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:39.970019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:39.970297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:39.970893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:39.972341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:39.983756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:39.984819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:39.986071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 314/620] 10.222.0.50 () {56 vars in 1129 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:39.987155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.003267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.004178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.004706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.005663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.005881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.006117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.007499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.013190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 307/621] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.014076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.108094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493cdbe5-e11d-4e78-aecf-2eff4592a470 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.117916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc698-cb8b-4c60-a8de-e72e75b47b9a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.143732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.144466 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.144746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.145018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] PATH_INFO: `/v3/services/network` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.145640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.147301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.152705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.153374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.153660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.153936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:40.156909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:40.157915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:40.158777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 315/622] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:39 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:40.159566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.168281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.169793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:40.184739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:40.185955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:40.187113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:40.187113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:40.187113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:40.187113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 308/623] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:40.187113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.196385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.211548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.279630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ab5eb-a239-4134-a885-1e82fa834526 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.299997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9003c4-b3c2-4df5-90a4-dfdb9a1c1c2a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.322909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.323526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.323801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.324069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.324721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.325092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.326673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.333160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 316/624] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.333960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.341848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.342468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.342755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.343029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.343669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.343976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.345430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.357218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 309/625] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.357218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.453169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.470916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb36f0-40d4-4d38-8e3e-2d95397a4680 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.472130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.502176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b5c58-ae5b-41dc-8222-161488e5e14e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.515977 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.516976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.517563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.518046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.518921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.519477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.521293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.528038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 317/626] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.529310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.541677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.542290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.542567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.542836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.543483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.543851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.545995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.562026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 310/627] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.562987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.651056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f69cf3-cf29-49fe-8da0-dca4a1c7c5f4 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.685822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d646b5c-a3c0-430f-8646-c0a5efb044dd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.687649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.688347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.688685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.689018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.689737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.690102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.691517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.697651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 318/628] 10.222.0.50 () {56 vars in 1124 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.698448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.717825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.732814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.733528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.739012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.739012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.739012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:40.739012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.739012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.751827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 311/629] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:40.751827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.757006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.815665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49da08f5-c2b7-40d2-9f98-e3359af37da1 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.851589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.852216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.852524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.852797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.860615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.861964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:40.874074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:40.875047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 319/630] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:40.876493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:40.897473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27294d62-00a3-4901-862a-b908e156c3f0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:40.935476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:40.936409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:40.936959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:40.937557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:40.938439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:40.940087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:40.965297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:40.988777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764b10ea-0522-426d-90a8-56e1cf64fc23 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:41.023315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:41.023972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:41.024275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:41.024550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:41.025234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:41.026602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:41.045415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 312/631] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:23:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:41.046679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:41.126761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:41.141351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 320/632] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:23:40 2022] POST /identity/v3/endpoints => generated 337 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:41.199590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e580b44-d2d5-48b1-a850-1c743e718040 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:41.282688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:41.283681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:41.284162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:41.284632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:41.285678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:41.286188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:41.288009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb45c5-c963-4c87-8403-870e02653c1f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:41.302480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 313/633] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:41.309395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:41.436507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914f1cf7-f701-499c-822c-3118552e8d64 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:41.473417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:41.481158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:41.481402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:41.481774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:41.482457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:41.482753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=ddc59606d2aa4ce7aa86f25d905b9e6d) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:41.483062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:41.484505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56883bac-3438-4a89-80a9-21f50979cb1d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:41.493524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 321/634] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:41 2022] GET /identity/v3/role_assignments?user.id=ddc59606d2aa4ce7aa86f25d905b9e6d&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:42.069554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6641d-709b-4707-8e15-cc1db9a1ae8a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.070098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6641d-709b-4707-8e15-cc1db9a1ae8a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.070098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6641d-709b-4707-8e15-cc1db9a1ae8a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.072118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 314/635] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:42.077556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.078395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.078888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.098532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:42.100056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:42.171750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 322/636] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:42.446016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6641d-709b-4707-8e15-cc1db9a1ae8a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:42.555385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6641d-709b-4707-8e15-cc1db9a1ae8a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:42.566623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:42.592892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:42.593562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.593842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.594115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.605050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-f512f18b-76df-403d-a67c-f546c3c31770 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:42.609944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:42.610877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:42.611764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 315/637] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:23:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:42.618496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:42.626449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81eb29-5fd8-42d8-a62c-1e7a123d3975 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.626733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81eb29-5fd8-42d8-a62c-1e7a123d3975 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.627016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81eb29-5fd8-42d8-a62c-1e7a123d3975 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.628480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 316/638] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:42.633392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.634201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.634481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.653030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:42.654246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:42.731008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c2cb73-eabc-4ad9-ae20-b31de1f55206 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:42.741192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 317/639] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:42.764580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:42.773974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:42.776944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.776944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.776944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.776944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:42.777407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:42.778965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:42.787719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 323/640] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Oct 12 12:23:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:42.794997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:42.903510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:42.909692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a062229-06c2-4da4-8b44-4b3bf8eab34b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:42.944638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:42.945343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:42.945624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:42.945949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:42.956677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:42.958179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:42.973056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:42.974120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:42.975101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:42.975101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:42.975101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:42.975101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 318/641] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:42.982112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.046653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.088631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f76be-ee8f-4c15-b830-65a762235da7 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.125538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.126549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.127110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.127596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.128452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:43.128967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.130567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.147990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 324/642] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:43.149817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.150406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41a8a5-20f0-4d89-90ef-95506979777b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.191012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.191540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.191812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.192083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.192803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.194521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.204367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:43.257395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bea9be-326e-4cb8-84d3-74b2383e3f97 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.277494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 319/643] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:43 2022] POST /identity/v3/services => generated 269 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:23:43.310846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.311518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.311803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.312084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.322425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.323961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:43.338275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:43.339287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:43.340223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 325/644] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:43.345847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.373047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:43.465295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3fa86-39e6-4763-9331-132600ff4c77 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.507755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.508379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.509211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.509479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.510213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:43.510513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.511936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61c059-ae76-4c5d-8039-a52765c66dfa None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.531350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 320/645] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:43.537099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.598478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74bea-978f-42c2-ac58-383840a8c368 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.598769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74bea-978f-42c2-ac58-383840a8c368 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.599046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd74bea-978f-42c2-ac58-383840a8c368 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.600639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 321/646] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:43.605661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.605944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.606217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.624989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:43.626210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:43.648396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b221791-299c-4c35-9f9f-e667af0fbfc8 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.652384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:43.692408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.693520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.693520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.694048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.702056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:43.708305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.709977 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.718319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 322/647] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:43 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-3553caf4-8e2b-4775-8bb6-68c30c07f92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:43.731382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:43.732388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:43.733315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:43.733315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:43.733315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:43.733315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 326/648] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:43.739556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.816309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ffa3-9068-4b48-91df-50bb629cdede None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.816664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ffa3-9068-4b48-91df-50bb629cdede None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.816867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5ffa3-9068-4b48-91df-50bb629cdede None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.822948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 327/649] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:43.824451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.824740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.825019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.844822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:43.846069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:43.847109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60343e61-a7fd-44e6-8adc-63a497864673 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:43.890011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:43.890624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:43.890901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:43.891173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:43.891818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:43.892119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:43.894226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:43.915401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 323/650] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:43.916468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:43.929384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 328/651] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:43 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:43.985241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:43.994644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.032271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244557aa-f75f-40a5-a93c-84c92063d000 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.069377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.070011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.070287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.070554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.080692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.082281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:44.093959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:44.094903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:44.095785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:44.099901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 324/652] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:44.100845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.108685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.132324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550e68a-6003-4b19-b09a-025ccbdc75e4 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.182699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.183724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.184693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.185221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.186023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.188436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:44.203104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:44.204493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:44.205463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.209239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 329/653] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:44.209239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.217341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87da3e-3a9a-4458-9dec-0247a5c18c95 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.239157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.253560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.255603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.255603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.255603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.255885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:44.256340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.257802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.270019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 325/654] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:44.270818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.331511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee23505d-1365-46cd-8f9c-11db25dbe6b0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.371684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.372465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.372746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.373017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.373621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.374987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.377114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bc542-9d34-4e46-81b8-50655fad4733 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:44.384457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:44.385496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:44.386345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 330/655] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:44.387119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.404472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.422242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.422853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.423134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.423409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.424042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:44.424342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.425747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.430664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 326/656] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:44.436468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.484333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.494958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa36a-00cc-4401-882f-ffe74561144b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.529496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.530284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.530741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.530850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/1ea7c1b7087545fabde10f0460530873/roles/078ec62fabbe407da221ea0efd831a8a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.532959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=1ea7c1b7087545fabde10f0460530873, role_id=078ec62fabbe407da221ea0efd831a8a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.534436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.539709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cbd80-8028-4322-ad88-ab93f1ac0755 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.573403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.574005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.574294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.574558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.575176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:44.575523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.576831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.581251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 327/657] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:44.582015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.651544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 331/658] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:23:44 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/1ea7c1b7087545fabde10f0460530873/roles/078ec62fabbe407da221ea0efd831a8a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:23:44.652715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:44.701788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee86e-2354-4481-8300-236f9e25036a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.714068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.743533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.744360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.744718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.745169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.745842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:44.746214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.747809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a111a84-54e9-47ec-8882-34bffc9a7106 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.757659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 328/659] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:44.764846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:44.795975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003eac89-7cbc-4b43-bb16-8b52364719ec None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:44.838277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:44.839308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:44.839774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:44.840218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:44.841144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:44.841701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:44.843422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6185b2a4-5e0b-4fba-9546-bac77846df32 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:44.849515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 332/660] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:45.597689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd1f-b1f8-45ac-a86b-f435f062f31e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:45.598241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd1f-b1f8-45ac-a86b-f435f062f31e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:45.598241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37dd1f-b1f8-45ac-a86b-f435f062f31e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:45.599928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 329/661] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:45.605831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:45.606289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:45.606434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:45.624708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:45.625931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:45.699235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 333/662] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:45 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:45.967675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd1f-b1f8-45ac-a86b-f435f062f31e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:46.075680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37dd1f-b1f8-45ac-a86b-f435f062f31e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:46.113691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:46.114697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.115170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.115643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.116406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:46.118049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:46.127528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:46.128434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:46.129334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:46.131953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 330/663] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Oct 12 12:23:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:46.138219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:46.204891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:46.244643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154e6dc-b1be-4ee7-b3f9-71ba2e0f4200 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:46.283095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:46.283708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.283996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.284270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.284898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:46.285231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:46.286598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:46.291624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 334/664] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:46.297228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:46.341107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:46.412340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d7738-6398-4dc6-8757-cbb1f247c8c5 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:46.447591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:46.448249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.448526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.448845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.449507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:46.449805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:46.451222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:46.456472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 331/665] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:46.462361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:46.571000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e21e76-342a-4e5b-954c-30f3fdfa9239 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:46.605221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:46.610845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:46.611506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.611740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.612014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.612722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] RBAC: Adding query filter params (interface=public, service_id=4a7efb84a5db49dd81bb43297885c259, region_id=RegionOne) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:46.613030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:46.614426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becfb910-b3a0-4f22-af3f-2976ede09ab3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:46.620918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 335/666] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:46 2022] GET /identity/v3/endpoints?service_id=4a7efb84a5db49dd81bb43297885c259&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:46.626521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:46.731208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:46.735198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e2621-c9b1-4f33-aeaf-e570325a5a4a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:46.769963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:46.770945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.771450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.771935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.772752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:46.774887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338cfed-accc-4523-bef0-5129f018f158 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:46.781236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 332/667] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:46 2022] GET /identity/v3/services => generated 1029 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:23:46.965498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae06e4-098e-4b2b-8262-fa1288ee98f4 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.965834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae06e4-098e-4b2b-8262-fa1288ee98f4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.966065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae06e4-098e-4b2b-8262-fa1288ee98f4 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.967675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 336/668] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:46.973530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e509d8-dce9-49d4-b679-6ef7b1e996f1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:46.974193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e509d8-dce9-49d4-b679-6ef7b1e996f1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:46.974674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e509d8-dce9-49d4-b679-6ef7b1e996f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:46.995244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f7e509d8-dce9-49d4-b679-6ef7b1e996f1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:46.996829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f7e509d8-dce9-49d4-b679-6ef7b1e996f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:47.034447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea4ff-24a1-471d-87f0-04b3148d15fd None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.034812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea4ff-24a1-471d-87f0-04b3148d15fd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.035159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1ea4ff-24a1-471d-87f0-04b3148d15fd None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.036995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 337/669] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:47.043011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.043589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.044074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.063751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:47.064947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:47.080529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 333/670] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:46 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:47.088167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cae0-a357-4dfd-b203-3b0a2b4ef031 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.089353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cae0-a357-4dfd-b203-3b0a2b4ef031 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.089353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca5cae0-a357-4dfd-b203-3b0a2b4ef031 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.090962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 334/671] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:47.097855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.098479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.098967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.120168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:47.121862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:47.151398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 338/672] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:47.202655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 335/673] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:47 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:47.361650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:47.421455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:47.460031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:47.475251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974bd70-4737-472f-a542-827ceb46afaf None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:47.503979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:47.513321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:47.513963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.514241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.514562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.525782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:23:47.531123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:47.532057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:47.532920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 339/674] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:23:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:47.534248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:47.549045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82976ae8-c57c-4216-8730-04aac7b8ef96 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:47.584440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:47.584985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.585323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.585576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.586244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:47.588144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:47.639344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1462571a-2b2b-4cfa-8b42-feaa72de1cfa None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:47.673424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:47.674032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.674312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.674586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.675234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:47.676642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:47.683432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 336/675] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:47 2022] POST /identity/v3/services => generated 251 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:23:47.684340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:47.754594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 340/676] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:47 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:47.807471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:47.835337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79496a-c835-47d0-8696-85a9fcfdda51 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:47.887000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:47.887259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:47.887517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:47.887786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:47.888474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:47.888777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:47.890328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:47.901362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 337/677] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Oct 12 12:23:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:47.907243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:47.960184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.022383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae4c2a-7783-430b-b40e-a94ddd36dece None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.059566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.060201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.060477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.060747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.072774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.074317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:48.089787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:48.090798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:48.091766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:48.091766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:48.091766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:48.091766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 341/678] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:48.096759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:48.204396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be06f83-0739-4b2b-a184-789a4e4ad76f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.241413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.242025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.242304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.242578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.243803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:48.244103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.245671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.252744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.262898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 338/679] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:48.268729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:48.372501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.376278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49db8dc-71d3-416b-8fc3-1bad4789d1de None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.411644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.412595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.412875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.413172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.421224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.422733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:23:48.435294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:48.436265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:48.437232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 342/680] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:48.442775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:48.550223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b5aea-91b2-4892-a6df-bf865f000552 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.587011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.587874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.588303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.588720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.589627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:48.590103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.591682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.610599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 339/681] 10.222.0.50 () {56 vars in 1149 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:48.621158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:48.724121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa9ff5-38f7-4940-a381-7818212296cc None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:48.759645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:48.760266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:48.760543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:48.760814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:48.792271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:48.834712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:48.836165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c1858-bd6f-4dac-852f-40492bef6f8d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:48.936304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 343/682] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:23:48.942021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.005218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.053103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e9ce7-f28e-48f7-b2b8-a2e44b55441d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.078611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d1b4-ae38-48f0-81ab-6613e680b940 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.078906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d1b4-ae38-48f0-81ab-6613e680b940 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.079182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d1b4-ae38-48f0-81ab-6613e680b940 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.080670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 344/683] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:23:49.085582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.085869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.086151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.097194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.098167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.098648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.099135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.106538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:49.107742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:49.111587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.113281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:23:49.129717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:49.130978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:23:49.131871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:23:49.131871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:23:49.131871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:49.133512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 340/684] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:49.139227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.175202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.192031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 345/685] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:49.251889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba32b8-e6e9-4474-8b68-86c5381ab55f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.261231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.287852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.288656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.289116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.289605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.290980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:49.291429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.292996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.307309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 341/686] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:49.317198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.427003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783680c-d53c-4770-8e4a-61e82c05c103 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.459092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.464426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.465368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.465854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.466328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.473739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.475443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:49.487405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:49.488299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:49.489199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:49.496044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 346/687] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:49.497477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.548510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.566806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695743-3063-48fc-bbdf-e564117f1543 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.602707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf2af8-5771-4ff2-8418-0c7cd545a278 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.605966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.606765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.607051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.607328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.607917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.609311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:49.622974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:49.623954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:49.625572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 342/688] 10.222.0.50 () {56 vars in 1132 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:49.630071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.650269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.651453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.652295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.653046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.653973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:49.654472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.656181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.669953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.675856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 347/689] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:49.678093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.769895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fed386-6537-44a1-8ced-73f39ee9f9ed None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.795301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0178f1d-b64b-452e-8ed1-544ed7cb5a7b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:49.810376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.817021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.817754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.818042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.818320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.819377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:49.819686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.821936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.829269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 343/690] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:49.834216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:49.843943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:49.844932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:49.845485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:49.845960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:49.846971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] RBAC: Adding query filter params (role.id=078ec62fabbe407da221ea0efd831a8a, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=1ea7c1b7087545fabde10f0460530873) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:49.847491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:49.849209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:49.864390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 348/691] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/role_assignments?user.id=1ea7c1b7087545fabde10f0460530873&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=078ec62fabbe407da221ea0efd831a8a => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:49.955853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:49.963848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afd216-1192-4a09-9e0f-4fdc93735ccd None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.003914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.004912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.005444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.005911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.006815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:50.007329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.009819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b1b8f-3c97-4595-b985-b0984eeb711e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.016385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 344/692] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:50.022429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.040422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca293ea-5b92-4442-a512-37cc5c549eb7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.040752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca293ea-5b92-4442-a512-37cc5c549eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.040988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca293ea-5b92-4442-a512-37cc5c549eb7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.042699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 345/693] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:50.048260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd4fc-baa5-49cf-8039-d94b9e09d554 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.048553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd4fc-baa5-49cf-8039-d94b9e09d554 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.048818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfd4fc-baa5-49cf-8039-d94b9e09d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.070039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6ecfd4fc-baa5-49cf-8039-d94b9e09d554 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:50.071184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6ecfd4fc-baa5-49cf-8039-d94b9e09d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:50.144594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 346/694] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:50.145421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe2c2f-4ed7-4c4f-ae59-641a0cb9d674 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.145904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031078-61f4-4640-8a8a-36d863c078d1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.146192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031078-61f4-4640-8a8a-36d863c078d1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.146467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e031078-61f4-4640-8a8a-36d863c078d1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.147991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 347/695] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:50.153356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.154716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.155166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.177991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:50.179585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:50.190943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.191607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.191894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.192167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.192848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.194569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.254211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 348/696] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:50.278757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 349/697] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:23:50 2022] POST /identity/v3/endpoints => generated 347 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:23:50.422277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.448745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:50.529574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94370bc4-16cd-4e4f-8523-f750c9d1c8d4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.535281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.566906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:50.575326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.577891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.577891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.577891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.578271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.579765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:50.591610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:50.592838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:50.593733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 349/698] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:50.598958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.656916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa496e-8206-4724-9585-c96dedb96726 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.696348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.696967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.697364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.697499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:50.697674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.698221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.699931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:50.708997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:50.716241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:50.717318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 350/699] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:50.722787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.725163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6dcd7-393a-46c5-b359-966f2c281cf4 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.763523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.764485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.765065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.765579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.766461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:50.766991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.768547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.779407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 350/700] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:50.780670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.841147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:50.852249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dce03-dc81-4639-9746-5b86637c5f04 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.897426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.898678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.899164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.900226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.901176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:50.901705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.903171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5f4457-62ce-4c33-8063-97151d0a3a79 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:50.903534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.908982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 351/701] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:50.915276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.939824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:50.940754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:50.941210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:50.941681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:50.942475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:50.942924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:50.944816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:50.951035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 351/702] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:50.956785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:50.972529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.041151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353a7c2-313a-4463-a261-e9d7f7ab0023 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.080819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.081771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.082039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.082322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.082964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:51.083273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.084653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.096007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 352/703] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:51.096934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:51.097308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130101a-bcb4-4ca7-968a-4251fc36f953 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.129481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.135784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.136482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.136988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.137437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.138629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] RBAC: Adding query filter params (interface=public, service_id=1d76fa30a81f41da8db8531661be7707, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:51.143240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.143240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.153158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 352/704] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:50 2022] GET /identity/v3/endpoints?service_id=1d76fa30a81f41da8db8531661be7707&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:51.155220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:51.220156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8f8e0-3759-4bdf-8df5-0dfd099feabb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.235830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.262108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.262744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.263027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.263305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.264035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] RBAC: Adding query filter params (interface=public, service_id=18f3d2418ac54158a71b7b093aa0103d, region_id=RegionOne) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:51.264351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.266200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.272571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 353/705] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:51 2022] GET /identity/v3/endpoints?service_id=18f3d2418ac54158a71b7b093aa0103d&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:51.273389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ef1dc-bf13-4981-a304-ea9616ff0709 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.278577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:51.311528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.312589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.313154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.313662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.314463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.316134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b749aed1-6145-4c93-a994-60423bd0bba6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.329281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 353/706] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:51 2022] GET /identity/v3/services => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:23:51.374548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:51.392855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfff3a4-e092-4afc-b814-e9783beb0b81 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:51.431994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:51.432804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:51.433089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:51.433391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:51.434012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:51.435463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc52ba-90ee-465b-894d-f67361dd0660 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:51.442558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 354/707] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:51 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:23:52.106248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e30720-c58d-4ad7-a31e-bf35efc0cf1a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.106799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e30720-c58d-4ad7-a31e-bf35efc0cf1a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.106799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e30720-c58d-4ad7-a31e-bf35efc0cf1a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.108373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 354/708] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:52.113993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea67ea-1cae-4883-b23c-d402f6a53ab5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.114462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea67ea-1cae-4883-b23c-d402f6a53ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.114674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea67ea-1cae-4883-b23c-d402f6a53ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.135312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-09ea67ea-1cae-4883-b23c-d402f6a53ab5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:52.136507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-09ea67ea-1cae-4883-b23c-d402f6a53ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:52.216347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 355/709] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:52.502067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e30720-c58d-4ad7-a31e-bf35efc0cf1a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:52.571375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add08c-8e0b-4b46-b0fd-13cf31d5fe47 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.571706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add08c-8e0b-4b46-b0fd-13cf31d5fe47 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.571943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8add08c-8e0b-4b46-b0fd-13cf31d5fe47 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.573558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 356/710] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:52.578665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.578954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.579235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.597392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:52.598601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:52.612701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e30720-c58d-4ad7-a31e-bf35efc0cf1a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:52.655045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:52.656027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.656507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.656996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] PATH_INFO: `/v3/services/image` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.657820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:52.659384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:52.662656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:52.670053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:52.676463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:52.677349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 355/711] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Oct 12 12:23:52 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:52.678142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:52.691945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 357/712] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:52.787145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c5af5-ce3d-47cb-94ee-b04327a62e6a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:52.822836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:52.823441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.823717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.823989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.824665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] RBAC: Adding query filter params (name=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:52.824969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:52.826424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:52.835960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 356/713] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:52.837878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:52.848560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:52.937331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d0092-5b2e-45eb-a78b-00dbb7cecfd5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:52.974672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:52.975585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:52.976096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:52.976575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:52.977451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:52.978498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:52.980069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:52.985320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 358/714] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:53.014607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:53.087579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:53.130542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58543165-eeb9-479c-a797-9851e4b2fc3a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:53.169645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:53.170276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.170555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.170825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.171416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:53.172854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:53.182575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:53.183597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:53.184527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 357/715] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:53.191106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:53.273549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:53.305053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a46b4b-1569-412a-b3a5-800d226774b1 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:53.341940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:53.342490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.342775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.343058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.343697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:53.344005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:53.345423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90174a9b-5d68-4a3f-b4bd-6a5b27bd521a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:53.350931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 359/716] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:53.356543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:53.471305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3b4ed-f9f9-44fc-9173-b87f877ed5d0 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:53.500747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:53.510132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] RBAC: Adding query filter params (type=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:53.514817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9487-dc1b-4829-92b3-1c0e74d296ec None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:53.518692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 358/717] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:53 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:53.574252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05694e1-cb18-47c1-8705-94e6cb1df037 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.574578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05694e1-cb18-47c1-8705-94e6cb1df037 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.574808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05694e1-cb18-47c1-8705-94e6cb1df037 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.576377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 360/718] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:53.582464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21612-deda-41f7-ba07-5ed5225c8648 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.583119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21612-deda-41f7-ba07-5ed5225c8648 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.583600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f21612-deda-41f7-ba07-5ed5225c8648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.604796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b3f21612-deda-41f7-ba07-5ed5225c8648 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:53.606542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b3f21612-deda-41f7-ba07-5ed5225c8648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:53.685351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 359/719] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:53.726761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7ee3f-4ef3-4912-8be7-6d7031497a4f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.727382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7ee3f-4ef3-4912-8be7-6d7031497a4f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.727910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7ee3f-4ef3-4912-8be7-6d7031497a4f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.729515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 361/720] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:53.735254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:53.735727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:53.736171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:53.755361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:53.756780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:53.828258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 360/721] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:53.959784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7ee3f-4ef3-4912-8be7-6d7031497a4f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.067955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7ee3f-4ef3-4912-8be7-6d7031497a4f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.104140 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.104779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.105060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.105367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.105956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.107394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.110071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:54.116752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:54.117733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.119155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 362/722] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:54.124701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.144367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.201547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.247797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc934a2-33d9-45c0-9e41-64f161851778 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.291116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.292339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.293091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.293616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.295088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:54.295616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.297446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.304611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 361/723] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:54.313070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.383288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c907e8-add4-4eb1-9bb2-55e462d33564 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.422207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.423004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.423352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.423800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.424528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.426175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:54.436793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:54.437935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:54.438971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:54.443600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 363/724] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:54.444687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.459591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccde31e-0733-4c08-a70a-17e5e9b84832 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.486853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.513955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.514531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.514812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.515079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.515704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:54.516004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.517399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.528436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 362/725] 10.222.0.50 () {56 vars in 1114 bytes} [Wed Oct 12 12:23:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:54.529003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.529304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.580043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8b80c-e25a-4a31-9f7f-e1dbde8f5230 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.621556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.622427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.622804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.623226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.624020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:54.624471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.625972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.636123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 364/726] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:54.637196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.645171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75b555-1f2c-4bf4-9db6-4e5920e3d214 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.692528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.693413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.693867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.694561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.695918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.698080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.746027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f10779-5e43-402c-93f5-5ab64ce643a9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.773827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.782427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 363/727] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:23:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:54.798878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.799573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.799855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.800205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.800862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:54.801247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.802728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4afa97-0be0-4873-9827-3fa0f353b50e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:54.809663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 365/728] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:54.815590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:54.857643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:54.935398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9056092-83ec-4f11-b853-8f4bfce57e87 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:54.973030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:54.973673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:54.973949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:54.974219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:54.974905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:54.976268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8f3e1-ff62-4e56-8c18-4f4a3838c995 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:55.067827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 364/729] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:23:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:23:55.304858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d55a-8b9f-4efd-a868-a0a0d9ffd1be None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:55.305191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d55a-8b9f-4efd-a868-a0a0d9ffd1be None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:55.305442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d55a-8b9f-4efd-a868-a0a0d9ffd1be None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:55.306909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 366/730] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:55.312801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1182-fd87-474c-bf01-2b3ab9707e03 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:55.313304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1182-fd87-474c-bf01-2b3ab9707e03 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:55.313378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a1182-fd87-474c-bf01-2b3ab9707e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:55.332672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-908a1182-fd87-474c-bf01-2b3ab9707e03 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:55.333911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-908a1182-fd87-474c-bf01-2b3ab9707e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:55.409779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 365/731] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:55.680316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d55a-8b9f-4efd-a868-a0a0d9ffd1be None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:55.790541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d55a-8b9f-4efd-a868-a0a0d9ffd1be None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:55.814542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebac38-372a-4ece-974a-d19b021929f4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:55.814859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebac38-372a-4ece-974a-d19b021929f4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:55.815092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebac38-372a-4ece-974a-d19b021929f4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:55.817236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 366/732] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:55.822664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:55.822942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:55.823212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:55.827572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:55.828281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:55.828558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:55.828828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:55.829520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:55.830877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4dcaa-3563-4573-a9ae-137711e996d6 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:55.841398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:55.842717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:55.856928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:55.915949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 367/733] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:55 2022] POST /identity/v3/services => generated 242 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:55.921378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 367/734] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:56.182236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:56.284507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d018d7c-6a64-422e-8a4e-86e67a086433 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:56.333568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:56.334184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:56.334461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:56.334729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:56.335383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:56.336751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea610b9-4b12-4426-86c7-9c9cb446eab1 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:56.413018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 368/735] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:23:56 2022] POST /identity/v3/services => generated 242 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:23:57.041528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc6c2-6fb1-4ce5-babc-cb63a14d4250 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.042069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc6c2-6fb1-4ce5-babc-cb63a14d4250 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.042069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7cc6c2-6fb1-4ce5-babc-cb63a14d4250 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.043642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 368/736] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:57.048774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef0fe-66e1-4dda-b6d7-99ac78b9f311 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.049067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef0fe-66e1-4dda-b6d7-99ac78b9f311 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.049376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef0fe-66e1-4dda-b6d7-99ac78b9f311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.056703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:57.068846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b62ef0fe-66e1-4dda-b6d7-99ac78b9f311 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:57.070404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b62ef0fe-66e1-4dda-b6d7-99ac78b9f311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:57.150982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 369/737] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:57.288687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576464a-664e-4222-9c8a-5d79cd4d3962 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.289014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576464a-664e-4222-9c8a-5d79cd4d3962 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.289274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576464a-664e-4222-9c8a-5d79cd4d3962 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.290816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 369/738] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:57.296522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.296803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.297000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.316779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:57.318003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:57.389803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 370/739] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:57.438782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576464a-664e-4222-9c8a-5d79cd4d3962 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:57.492135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:57.546474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576464a-664e-4222-9c8a-5d79cd4d3962 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:57.583137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:57.584069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.584563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.585029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.585907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:57.587624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:57.590580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING keystone.server.flask.common [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 12:23:57.631432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.sql.core [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:23:57.631432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:23:57.631432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [parameters: {'id': '3331f1bf8c0046b9a3dae87eb6fc15df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 12:23:57.631432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81526) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3331f1bf8c0046b9a3dae87eb6fc15df.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3331f1bf8c0046b9a3dae87eb6fc15df. Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:23:57.639956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result.read() Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:23:57.640786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application yield resource Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise self.value Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application session.commit() Oct 12 12:23:57.641870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:23:57.643051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:23:57.644242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application result.read() Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:23:57.645269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [parameters: {'id': '3331f1bf8c0046b9a3dae87eb6fc15df', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.646203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:57.646989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3331f1bf8c0046b9a3dae87eb6fc15df. Oct 12 12:23:57.647947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.650178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 370/740] 10.222.0.50 () {60 vars in 1140 bytes} [Wed Oct 12 12:23:57 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:57.656341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:57.664598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:57.735946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:57.789736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e050611-ca5a-4d62-b91c-fb0e2d3ceb1c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:57.794235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:57.797761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7eebc7-e5d7-466f-84be-78ca4a5bf0ce None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:57.831396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:57.832044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.832323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.832597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.833425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:57.834936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:57.842375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:57.843256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:57.843761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:57.844259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:57.846326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:57.847267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:23:57.848155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:57.854027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 371/741] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:23:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:57.856250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:57.859471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:57.862099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:23:57.877837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:57.878776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:23:57.879638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:57.882226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 371/742] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:57.888744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:57.968608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534368-a8e9-46fb-862f-6afa69b3bcd2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.001070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e53e1f-d87f-4d58-ace2-3beffca24659 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.003360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.003973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.004249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.004525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.005589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:58.005589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.006890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.019642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 372/743] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:58.020686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:58.034882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:58.051643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.052917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.053283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.053825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.054731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:58.055332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.056234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:58.058435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.086988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 372/744] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:57 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:58.135961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7d5d2-47d9-482f-910a-0b535e4ee117 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.175345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.175965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.176303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.176579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.177247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:58.177551 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.178932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec87ef-0e7c-43fa-b226-0f007699c21d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.185102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 373/745] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:58.191092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:58.214757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d0fb-9527-4cc4-a5b6-09386741b280 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.215322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d0fb-9527-4cc4-a5b6-09386741b280 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.215794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d0fb-9527-4cc4-a5b6-09386741b280 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.217681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 374/746] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:58.223502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.223816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.224207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.246297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:58.248026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:58.329521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84b986-4043-4f4d-80f5-9bc6994b13d8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.342468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 375/747] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:23:58.375315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.376175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.376602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.377041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.377996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] RBAC: Adding query filter params (interface=admin, service_id=18f3d2418ac54158a71b7b093aa0103d, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:58.378449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.379961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d724cf2-c392-4cf3-8ab3-b765f950cb36 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.386341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 373/748] 10.222.0.50 () {56 vars in 1249 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/endpoints?service_id=18f3d2418ac54158a71b7b093aa0103d&interface=admin®ion_id=RegionOne => generated 193 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:58.392294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:58.422127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:58.500964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dc32d-697e-403f-bb56-e84f0626d951 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.539456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.540063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.540368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.540636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.541262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.542687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08c4a32-ed31-4adc-ae00-c28f9eb24ac2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.550014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 376/749] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:23:58.607200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515696-a27e-4443-bf82-55699e36e078 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.607722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515696-a27e-4443-bf82-55699e36e078 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.607722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed515696-a27e-4443-bf82-55699e36e078 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.609358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 374/750] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:23:58.615025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.615310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.615550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515696-a27e-4443-bf82-55699e36e078 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:58.615661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.634971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:23:58.636371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:23:58.672308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:58.736213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 377/751] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:23:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:23:58.739712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed515696-a27e-4443-bf82-55699e36e078 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.784509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.785762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.785762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.785762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] PATH_INFO: `/v3/services/image` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.786341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.787748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:58.799068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:58.800077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:23:58.801076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 375/752] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:23:58.806876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:58.831170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:58.909945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456eb063-3e2b-4520-8952-7f62d6da89c2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:58.944803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:58.945442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:58.945719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:58.945991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:58.947179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] RBAC: Adding query filter params (name=image) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:58.947488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:58.948854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:58.954174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 378/753] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:58.959758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.040044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.077723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439710ea-813a-4cd0-b155-509ddce60174 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.093743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.115544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.116402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.116924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.117362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.118247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] RBAC: Adding query filter params (type=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:59.119329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.120955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.126691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 376/754] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:23:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:59.132979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.153219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.173926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f2083-93c9-424e-aae9-b99f198a691b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.214447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.215334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.215749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.216295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.217105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.218648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:23:59.228728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:23:59.229913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:23:59.230836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:23:59.237879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 379/755] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:23:59.239366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.267868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c22e19-c0a1-4419-9544-63fdd808c061 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.322369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.328174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.328465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.328742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.329504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] RBAC: Adding query filter params (interface=public, service_id=6e8e4444aab645f6941df006c5b7beb6, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:59.329815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.331206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.342024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 377/756] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/endpoints?service_id=6e8e4444aab645f6941df006c5b7beb6&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:23:59.342912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.357533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85dd57f-1b9b-4b44-9679-411946c901dc None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.381584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.393851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.394459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.394735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.395297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.395628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] RBAC: Adding query filter params (name=compute) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:59.396087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.397503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.407428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 380/757] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:59.408702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.426710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.455840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0ed28-69be-47bc-bfc4-24a156ae0050 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.494809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.495777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.496259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.496706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.497728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.499318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.508578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 378/758] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:23:59.522316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978048e5-5a00-4597-abfd-faeec829513c None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.562266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.562886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.563163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.563434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.564075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:59.564382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.565791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.577248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 381/759] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:59.582304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.700637 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.703522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e4062-fdd4-42aa-9de4-78d32c35196a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.739830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.740441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.740723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.740993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.741779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] RBAC: Adding query filter params (interface=public, service_id=fadf14a2af1247cb88af375a185a3563, region_id=RegionOne) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:23:59.742086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.743476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b3eb-f129-4eb4-bb3d-cb8b7877f318 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.750014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 379/760] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/endpoints?service_id=fadf14a2af1247cb88af375a185a3563&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:23:59.755681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:23:59.835784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:23:59.860355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f1d2-0e54-4e77-9be9-fec08780f57b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:23:59.896703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:23:59.897347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:23:59.897627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:23:59.897900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:23:59.898505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:23:59.900510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ced14-4188-4c39-a3f4-311a992e05e2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:23:59.907559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 382/761] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:23:59 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:24:00.476923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413efc84-4983-4034-8db6-ac7ef66e176a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:00.477349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413efc84-4983-4034-8db6-ac7ef66e176a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:00.477527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413efc84-4983-4034-8db6-ac7ef66e176a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:00.479201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 380/762] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:00.484746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d84fc-88ff-484d-8cd1-771d5ff2f019 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:00.485272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d84fc-88ff-484d-8cd1-771d5ff2f019 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:00.485385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d84fc-88ff-484d-8cd1-771d5ff2f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:00.505408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3c5d84fc-88ff-484d-8cd1-771d5ff2f019 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:00.506621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3c5d84fc-88ff-484d-8cd1-771d5ff2f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:00.580800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 383/763] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:00.785472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8e60-f8a9-4c85-a575-e39571f9a556 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:00.786006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8e60-f8a9-4c85-a575-e39571f9a556 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:00.786006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d8e60-f8a9-4c85-a575-e39571f9a556 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:00.787589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 381/764] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:00.793345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:00.793847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:00.794342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:00.814634 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:00.816225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:00.849505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8e60-f8a9-4c85-a575-e39571f9a556 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:00.886603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:00.891840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 384/765] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:00 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:00.959632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d8e60-f8a9-4c85-a575-e39571f9a556 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:00.999298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:00.999897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.000173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.000444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.001094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.002608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.005321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING keystone.server.flask.common [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 12 12:24:01.065887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.sql.core [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:24:01.065887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 12:24:01.065887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [parameters: {'user_id': 'e6d463733d9f49adbfefdbd0153c5cfb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 12:24:01.065887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81527) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:24:01.074460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:24:01.075320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application yield resource Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise self.value Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application session.commit() Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:24:01.076285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:24:01.077192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:24:01.078081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:24:01.078915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e6d463733d9f49adbfefdbd0153c5cfb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:01.079742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 12 12:24:01.080521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.083019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 382/766] 10.222.0.50 () {60 vars in 1131 bytes} [Wed Oct 12 12:24:00 2022] POST /identity/v3/users => generated 160 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:01.090420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.163579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.198547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:01.199062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa67581-38a5-4cfd-b071-f488b7f581ac None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.240996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.243847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.244369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.245328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.255456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.257241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:24:01.270891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:01.271856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 12 12:24:01.272788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:01.280628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 385/767] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:01.281702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.302045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf83962-d83d-4d11-a304-f6413801a408 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.346758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.347542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.347820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.348091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.348679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.351008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.354230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:01.363206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:01.364212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 12 12:24:01.365077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:01.369471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 383/768] 10.222.0.50 () {56 vars in 1126 bytes} [Wed Oct 12 12:24:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:01.370458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.406179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8f756-0ca9-4fc9-8587-52a26a790226 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.445842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.447367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.447878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.448447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.449500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:01.450006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.451754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.483792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:01.497235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d682-ac36-4b1b-a8fd-43497a3c77cc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.497931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 386/769] 10.222.0.50 () {56 vars in 1101 bytes} [Wed Oct 12 12:24:01 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:01.533922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.534545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.534810 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.535079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.535714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:01.536016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.537479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.546416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 384/770] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:24:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:01.552360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.673145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b506657-8ef1-4c81-b5b9-9e7f4f65f913 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.691912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:01.711870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.713056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.713365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.713639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.714299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:01.714605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.716051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b30469-0dce-41e5-a30e-23a608b3c389 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.722279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 387/771] 10.222.0.50 () {56 vars in 1122 bytes} [Wed Oct 12 12:24:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:01.729234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:01.834673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c865da-41cc-4426-afbc-b79894e00606 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.834991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c865da-41cc-4426-afbc-b79894e00606 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.835224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c865da-41cc-4426-afbc-b79894e00606 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.836567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 388/772] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:24:01.837722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358ee728-1573-4f39-8db5-9c9271a4a993 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:01.842180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8959ca-4c02-4e44-b06f-22f000298da7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.842459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8959ca-4c02-4e44-b06f-22f000298da7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.842734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8959ca-4c02-4e44-b06f-22f000298da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.860169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6e8959ca-4c02-4e44-b06f-22f000298da7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:01.861376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6e8959ca-4c02-4e44-b06f-22f000298da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:01.876377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:01.876987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:01.877302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:01.877579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:01.878368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:01.879863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f8de0f-9f9e-486e-9c48-b9671bc2c535 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:01.927989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 389/773] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:01 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:24:01.985232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 385/774] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:24:01 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:02.160678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ffe9-b3d6-4bae-b51d-025f2528491e None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.160961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ffe9-b3d6-4bae-b51d-025f2528491e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.161273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87ffe9-b3d6-4bae-b51d-025f2528491e None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.162642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 390/775] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:02.168615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.168905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.169259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.188817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:02.190384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:02.197663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ffe9-b3d6-4bae-b51d-025f2528491e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.201103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:02.269060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 386/776] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:02 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:02.314000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87ffe9-b3d6-4bae-b51d-025f2528491e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.328467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:02.348988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.349642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.349974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.350282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] PATH_INFO: `/v3/services/image` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.350878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.352243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:02.362285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:02.363264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 12 12:24:02.364098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:02.365534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 391/777] 10.222.0.50 () {56 vars in 1105 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:24:02.370062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.473172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eadcf3-eef6-4286-bd21-93f5c0883051 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.508298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.508907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.509213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.509487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.510109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] RBAC: Adding query filter params (name=image) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:02.510409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.511778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.516908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 387/778] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:02.522554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.551397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.556978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:02.625554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2212-1abf-4f69-b1c6-f1526ff33e44 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.661676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.662278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.662605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.662815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.663525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] RBAC: Adding query filter params (type=image) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:02.663727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.665081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.670525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab75d3-b9aa-42bb-9ef6-816f9a06ef17 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.675467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 392/779] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:02.676239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.706061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.706695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.706978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.707258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.707841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.709279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:02.718573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:02.719576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:02.720440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 388/780] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:02.723939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:02.725589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.787721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e287a-a91b-4635-8cac-fc8a78436a03 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.796223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:02.826854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.827461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.827738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.828010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.828674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.830061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.831114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983feb8a-b0e9-4e3e-9785-296204e77472 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:02.865775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:02.866422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:02.866645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:02.866980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:02.867611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:02.867913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:02.869339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:02.874297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 389/781] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:02.880794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:02.932508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 393/782] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:24:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:02.989825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68b0a0-a026-49ae-bd4c-6ee4995ca85d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:03.022345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:03.035484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:03.036148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:03.036431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:03.036701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:03.037368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:03.037675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:03.039107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3d1dc-9ec4-43b7-acd7-e15a1fa6dfb9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:03.049388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 390/783] 10.222.0.50 () {56 vars in 1112 bytes} [Wed Oct 12 12:24:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:03.050787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:03.155075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:03.161322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d813160-beed-4d49-9115-d6d0d218c229 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:03.196249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:03.197415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:03.198220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:03.198220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:03.198631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:03.199993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92380c-13f2-4cf9-8556-358305221aa0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:03.275473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 394/784] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:24:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:04.158714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c7b8-5556-47ad-a462-b656e500e6d1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:04.159250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c7b8-5556-47ad-a462-b656e500e6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:04.159250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851c7b8-5556-47ad-a462-b656e500e6d1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:04.160908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 391/785] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:04.166250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:04.167023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:04.167507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:04.186124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:04.187310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:04.263249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 395/786] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:04.528494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c7b8-5556-47ad-a462-b656e500e6d1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:04.632714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6851c7b8-5556-47ad-a462-b656e500e6d1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:04.666708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:04.667332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:04.667607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:04.667874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:04.668962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:04.670403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f82adc-1882-4294-92ea-e8f8ea122030 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:04.676754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 392/787] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:04.678112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:04.755844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:04.777309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec76146-cce3-4989-9e2c-c16d288b1609 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:04.811510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:04.812435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:04.812725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:04.812996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:04.813674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:04.815103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7257e-8010-4954-9c67-b1ed88861e57 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:04.880924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 396/788] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:24:04 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:05.127615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb9c0-f564-4d8a-82a4-09d1eb03ce00 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.127987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb9c0-f564-4d8a-82a4-09d1eb03ce00 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.128171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb9c0-f564-4d8a-82a4-09d1eb03ce00 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.129702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 393/789] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:05.135322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8307-cab1-49fd-97a9-3ae20b1205e9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.135679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8307-cab1-49fd-97a9-3ae20b1205e9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.136021 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed8307-cab1-49fd-97a9-3ae20b1205e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.154946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7bed8307-cab1-49fd-97a9-3ae20b1205e9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:05.156127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7bed8307-cab1-49fd-97a9-3ae20b1205e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:05.222736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 397/790] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:05.489403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb9c0-f564-4d8a-82a4-09d1eb03ce00 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:05.511517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a6e84-bef5-404e-987d-978cc97bc928 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.511798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a6e84-bef5-404e-987d-978cc97bc928 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.512225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a6e84-bef5-404e-987d-978cc97bc928 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.513950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 398/791] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:05.519731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.520013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.520287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.538624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:05.539817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:05.556062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:05.599889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:05.600916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb9c0-f564-4d8a-82a4-09d1eb03ce00 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:05.617170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 399/792] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:05.639014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:05.639625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.639906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.640179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.640910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:05.642377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:05.691337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.sql.core [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:24:05.691337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:24:05.691337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [parameters: {'id': '32aa321ea7e64dc9b88e9a02cdff9928', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:24:05.691337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81527) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:24:05.699073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 12 12:24:05.699896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application yield resource Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application next(self.gen) Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.rollback() Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.force_reraise() Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise self.value Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application session.commit() Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 12 12:24:05.701561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._prepare_impl() Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.session.flush() Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._flush(objects) Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application compat.raise_( Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application flush_context.execute() Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rec.execute(self) Oct 12 12:24:05.702454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 12 12:24:05.703321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result = self._query(query) Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application conn.query(q) Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application result.read() Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 12 12:24:05.704081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [parameters: {'id': '32aa321ea7e64dc9b88e9a02cdff9928', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 12 12:24:05.705050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:05.706140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:05.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 394/793] 10.222.0.50 () {60 vars in 1137 bytes} [Wed Oct 12 12:24:05 2022] POST /identity/v3/domains => generated 190 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:05.709259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:05.807459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1631e-e756-4b17-bd39-003333debfa6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:05.844143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:05.844773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:05.845048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:05.845355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:05.855117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:05.856550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:24:05.870608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:05.871558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:24:05.872518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:24:05.872518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:05.872518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:05.873475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 400/794] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:05.877887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:05.888206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:05.937229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:05.984726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8858f31-4356-451a-85fe-36b09fb0f4f9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:05.997546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f058b8-155e-4bbd-ae79-320afef5d8c3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.008861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:06.021159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.021864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.022143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.022413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.023051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:06.023350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.024737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.035595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.036232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.036517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.036794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.045245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 395/795] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:06.061612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:06.063006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:06.064077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:24:06.065080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:06.069383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 401/796] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:24:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:24:06.070978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.182231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d54a9-0b7f-43a5-91d8-301826a78edb None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.220638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.221285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.221564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.221834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.222497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:06.222803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.224188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.232844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 396/797] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:06.238601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.354649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a0237-1683-435b-b9ec-2b0bf2f8ea4a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.356388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:06.389838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.390474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.390755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.391028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.400902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.402381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:24:06.416480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:06.417448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:24:06.418320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:24:06.418320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:06.418320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:06.421425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 402/798] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:06.423616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.469655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:06.522829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a354f79-2d72-4982-9b27-d66cf1243524 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.554967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.555568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.555844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.556651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.557310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:06.557609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.558962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.570481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 397/799] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:06.576821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.673926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc2ab5-3b68-46f5-aa0c-ca3b5e99ee0d None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.707008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.707631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.707907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.708178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.715496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.716913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:24:06.727835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:06.729436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:06.730390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 403/800] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:06.735377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.832517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d58ead-abf8-41a3-8831-7cb506baa375 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:06.839860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:06.866120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:06.866727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:06.867011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:06.867292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:06.868016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:06.868322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:06.870396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:06.887671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 398/801] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:06.893342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:06.909375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:06.992614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b740ffb-6734-4722-a42e-0dda5412cb9f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.028701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.029358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.029638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.029910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.040006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.042042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-426925e8-68d9-4af6-a951-dbffa597f84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:24:07.055982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:07.057096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:24:07.058149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:24:07.058149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:07.058149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:07.058149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 404/802] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:07.063218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.107332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e57c-3da7-4fa3-99f1-344d3da39bfd None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.107612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e57c-3da7-4fa3-99f1-344d3da39bfd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.107888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb16e57c-3da7-4fa3-99f1-344d3da39bfd None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.109394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 405/803] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:24:07.114440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.114728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.115003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.132701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:07.133922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:07.164723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f3575-d6ef-49ee-8d7c-5049ce0f113f None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.194005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:07.199769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.200374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.200653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.200925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.201595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:07.201899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.202004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 406/804] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:24:07.203270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.214986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 399/805] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:07.220603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.317465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2556d-60bf-43a1-8cc5-8457866efe23 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.353193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.353824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.354106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.354383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.361178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.362626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:24:07.373558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:07.374508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:07.375416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 407/806] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:07.380531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.406646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:07.471677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.479325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467b645-cb0d-45da-8a59-f1b30c5c244d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.514929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.515534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.515818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.516139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.516821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:07.517148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.518561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.528269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:07.531652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 400/807] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:07.537851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.572446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b65464-6e3d-41a7-a1f0-ad17af9edf33 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.606118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.606743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.607024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.607300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.608398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.609855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.611421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 408/808] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:07.616972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:07.619149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:07.635131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25a21-68b2-4c3b-830d-86881d666fea None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.669096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.669774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.670056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.670328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/078ec62fabbe407da221ea0efd831a8a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.672511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=cbb7f8775d5e4224a18fc0dd7a5f53b4, role_id=078ec62fabbe407da221ea0efd831a8a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.673988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b379664-8f07-4102-ac45-2482ef8a2413 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.714870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac057835-33f9-4a63-aa31-e07949138beb None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:07.736862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:07.747704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:07.748303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:07.748588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:07.748887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:07.749547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:07.750969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043a82-13b2-4bb0-98fd-e559e2f5103a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:07.754112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 401/809] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:24:07 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/cbb7f8775d5e4224a18fc0dd7a5f53b4/roles/078ec62fabbe407da221ea0efd831a8a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:24:07.812946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 409/810] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:24:07 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:24:09.858924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6fc8-e55c-403d-aa29-a57fc21cdf05 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:09.859508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6fc8-e55c-403d-aa29-a57fc21cdf05 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:09.859595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a6fc8-e55c-403d-aa29-a57fc21cdf05 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:09.861004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 402/811] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:09.866955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628e209-d5b7-4c62-8d12-76ca33a88b7b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:09.867490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628e209-d5b7-4c62-8d12-76ca33a88b7b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:09.867490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628e209-d5b7-4c62-8d12-76ca33a88b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:09.887084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e628e209-d5b7-4c62-8d12-76ca33a88b7b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:09.888305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e628e209-d5b7-4c62-8d12-76ca33a88b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:09.953402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 410/812] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:09.974226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038929-e602-450c-bc3f-feec66b2c496 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:09.974514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038929-e602-450c-bc3f-feec66b2c496 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:09.974787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f038929-e602-450c-bc3f-feec66b2c496 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:09.976261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 403/813] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:09.981195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:09.981517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:09.981795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.000094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:10.001323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:10.065552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 411/814] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:24:10.216811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038929-e602-450c-bc3f-feec66b2c496 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.315740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f038929-e602-450c-bc3f-feec66b2c496 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.338445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.352835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.354180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.354453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.354720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.364762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:10.370224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:10.371150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:10.372135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 404/815] 10.222.0.50 () {56 vars in 1120 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:10.377092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.381098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.381719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.439238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130c7f4f-17f2-4162-a8c7-4e8c65821d16 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.473274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.473505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d12beb-36c4-4ec9-af74-2649916158d8 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.473832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.474113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.474386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.485089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:10.489963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:10.490908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:10.491750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 412/816] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:24:10.497655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.509273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.509885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.510168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.510443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.511105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:10.511411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.512892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.520926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 405/817] 10.222.0.50 () {56 vars in 1115 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:10.526718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.591533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.596322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.599181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3c040-0a6d-4511-8d30-b29d622aa8f1 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.626738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93b5f93-c893-44ac-92e5-44350a3d38a3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.632971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.633610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.633886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.634159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.634846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:10.635152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.636529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.644460 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 413/818] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:10.650275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.660864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.661530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.661815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.662087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.673006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.674535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:24:10.688950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:10.689928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:24:10.690876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:24:10.690876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:10.690876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:10.690876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 406/819] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:24:10.696078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.799924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878572c3-79d5-45a9-b4ae-b7b5f6c7da35 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.833872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44cdf95-91dc-41f3-8e20-463335ff0e1e None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.834419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.835046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.835325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.835596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] PATH_INFO: `/v3/users/de6bd431b19040059d570797aafd5f69` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.849308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=de6bd431b19040059d570797aafd5f69)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.850748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.851291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.852416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 414/820] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/users/de6bd431b19040059d570797aafd5f69 => generated 285 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:10.858902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.868412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.869012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.869331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.869599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.870229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:10.870527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.871879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.879475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:10.883828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 407/821] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:10.889478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:10.957921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff99c0f-7314-421b-aa9a-a775f0b6a1f6 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.986656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402af7e8-3dcc-4cc6-b866-56330a490986 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:10.991959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:10.992586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:10.992864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:10.993184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:10.994285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] RBAC: Authorizing `identity:get_project(project_id=e83139dfcee742af9febeb89da6bea9b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:10.995717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:10.997363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 415/822] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:11.003176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.020015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.020639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.020920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.021223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.028899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.030358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:24:11.043314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:11.044276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 12 12:24:11.045241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:11.045788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 408/823] 10.222.0.50 () {56 vars in 1093 bytes} [Wed Oct 12 12:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:24:11.051259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.094067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:11.095503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:11.107316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84963791-ebad-473b-a448-b4d028e9e36f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.141574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.142244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.142713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.143139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b/users/de6bd431b19040059d570797aafd5f69/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.145452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83139dfcee742af9febeb89da6bea9b, user_id=de6bd431b19040059d570797aafd5f69, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.146889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.153327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273b1ba-691f-40ff-aab7-266f362cc329 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.186135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.186740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.187023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.187345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.188065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:11.188370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.189890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.207197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 409/824] 10.222.0.50 () {56 vars in 1133 bytes} [Wed Oct 12 12:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:11.211487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 416/825] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:24:11 2022] PUT /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b/users/de6bd431b19040059d570797aafd5f69/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:24:11.216893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.318858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:11.325554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aa0be-47c2-489f-8a85-23e48dc77eef None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.363293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.363908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.364185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.364514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.433478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.434941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.524650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:11.531081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 410/826] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:24:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:24:11.537043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.633631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4999954f-fa2a-4bc4-8b5e-2b33f6d5a921 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.666640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.667274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.667554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.667825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.678003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.679439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.688235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:24:11.694557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:11.696429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:24:11.698127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:24:11.698127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:24:11.698127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:11.698127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 417/827] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:11.702271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.799037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e58e5-e649-4963-8057-27e7770a2cd9 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.832260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.832853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.833144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.833423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.834052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:11.834352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.835766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:11.847214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 411/828] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:11.852790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:11.950948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8a30f-0306-4858-95b7-e42c92d3ae0f None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:11.983699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:11.984318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:11.984594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:11.984865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:11.991336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:11.992770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:24:12.004181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:12.005228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:12.006505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 418/829] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:12.011005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:12.065900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:12.110515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138b0ab-2583-430e-a5d5-5f7a2a76d27d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:12.143216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:12.143812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:12.144087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:12.144356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:12.145028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:12.145360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:12.146776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b208ec21-6ffc-4dbd-90b1-9dd44be6c4c9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:12.157736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 412/830] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:12.163844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:12.222457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:12.262179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91132933-51e2-4086-bf8c-481e1439629a None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:12.297215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:12.298200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:12.298678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:12.299164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:12.300011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] RBAC: Adding query filter params (role.id=078ec62fabbe407da221ea0efd831a8a, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:12.300327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:12.301808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c332b-851f-439d-9d83-ac362f9c697f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:12.307818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 419/831] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:24:12 2022] GET /identity/v3/role_assignments?user.id=cbb7f8775d5e4224a18fc0dd7a5f53b4&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=078ec62fabbe407da221ea0efd831a8a => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:13.352323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043f0b-ef99-4de5-bb4d-c1c79cc7a906 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:13.352733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043f0b-ef99-4de5-bb4d-c1c79cc7a906 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:13.352871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99043f0b-ef99-4de5-bb4d-c1c79cc7a906 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:13.354890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 413/832] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:13.360028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:13.367658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:13.367658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:13.378971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:13.380162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:13.443988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 420/833] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:13.713933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99043f0b-ef99-4de5-bb4d-c1c79cc7a906 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:13.813139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99043f0b-ef99-4de5-bb4d-c1c79cc7a906 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:13.828732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:13.846093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:13.846704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:13.846981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:13.847251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:13.858089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:13.862791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:13.863942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:13.865002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 414/834] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:13.869793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:13.922849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:13.966227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde15cd2-82fb-46da-a569-d7d7f64da6c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:13.998264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:13.998857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:13.999134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:13.999406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:14.000061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:14.000364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:14.001768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:14.009581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 421/835] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:14.015310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:14.112594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71a1c5-51fc-4089-aec1-4e5b132110f1 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:14.144665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:14.145297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:14.145578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:14.145849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] PATH_INFO: `/v3/users/de6bd431b19040059d570797aafd5f69` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:14.146942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] RBAC: Authorizing `identity:get_user(user_id=de6bd431b19040059d570797aafd5f69)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:14.148369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:14.149932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 415/836] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:14 2022] GET /identity/v3/users/de6bd431b19040059d570797aafd5f69 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:14.156205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:14.251026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa94a2-2332-4a90-ae28-4c47d20fdcf3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:14.266505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:14.283594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:14.288380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:14.288380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:14.288380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:14.350746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:14.352196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:14.445397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 422/837] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:24:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:24:14.451815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:14.499794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:14.553986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874759c-9e3a-4369-ae51-caaf60ef4f09 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:14.588414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:14.589182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:14.589525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:14.589859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:14.590980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=e83139dfcee742af9febeb89da6bea9b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:14.592404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae360d-1320-4c51-ae90-ad5750e9b1c7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:14.594309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 416/838] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:14 2022] GET /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:14.600330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:14.618048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:14.700643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16821-1948-4405-9c0e-44d9ef57d132 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:14.733730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:14.734335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:14.734611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:14.734883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:14.735594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=e83139dfcee742af9febeb89da6bea9b, user.id=de6bd431b19040059d570797aafd5f69) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:14.735900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:14.737346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ffb7a-a778-4927-bf8b-394208e0fbac None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:14.742875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 423/839] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:24:14 2022] GET /identity/v3/role_assignments?user.id=de6bd431b19040059d570797aafd5f69&scope.project.id=e83139dfcee742af9febeb89da6bea9b&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:16.855304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71198bd-0bc1-4e27-9dd8-512cf76701af None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:16.855848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71198bd-0bc1-4e27-9dd8-512cf76701af None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:16.855848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71198bd-0bc1-4e27-9dd8-512cf76701af None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:16.857209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 417/840] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:16.862387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:16.862817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:16.862940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:16.881168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:16.882359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:16.947555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 424/841] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:17.211793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71198bd-0bc1-4e27-9dd8-512cf76701af None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:17.310132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71198bd-0bc1-4e27-9dd8-512cf76701af None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:17.322783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:17.343032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b9072c-c55d-4adc-931d-0f4b2336ceb9 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:17.380840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 418/842] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:17.381392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:17.381392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:17.451076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e034a-bbc5-4a7d-ba39-40d6138024eb None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:17.484655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:17.485230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:17.489671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:17.489671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:17.489671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:17.489671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b5176-e818-42d8-b759-81cda71564fe None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:17.606081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 425/843] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:24:17 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:19.732074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ef6-ce69-40da-a8b2-3256454672d2 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:19.732625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ef6-ce69-40da-a8b2-3256454672d2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:19.732625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848ef6-ce69-40da-a8b2-3256454672d2 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:19.733980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 419/844] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:19.739081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:19.739497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:19.739636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:19.757995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:19.759180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:19.817793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:19.826141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 426/845] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 12 12:24:20.098219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848ef6-ce69-40da-a8b2-3256454672d2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:20.196792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848ef6-ce69-40da-a8b2-3256454672d2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:20.228995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:20.229627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:20.229903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:20.230169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] PATH_INFO: `/v3/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:20.231530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] RBAC: Authorizing `identity:get_role(role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:20.232878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:20.234182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 420/846] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:20 2022] GET /identity/v3/roles/7bcc7d784f624412826cfb09306c7c53 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:20.239804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:20.335233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5480b-7929-464d-b0de-4d3f32dec2b0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:20.368411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:20.369618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:20.369904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:20.370179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] PATH_INFO: `/v3/users/20d70cc4251244b780d35ba5e50cce2d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:20.382768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] RBAC: Authorizing `identity:get_user(user_id=20d70cc4251244b780d35ba5e50cce2d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:20.384206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:20.385854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 427/847] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:20 2022] GET /identity/v3/users/20d70cc4251244b780d35ba5e50cce2d => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:20.391588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:20.511385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:20.560755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287ac92-5ff4-4c8a-a42b-200161aaabbc None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:20.593175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:20.593796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:20.594076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:20.594347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:20.595447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] RBAC: Authorizing `identity:get_project(project_id=e83139dfcee742af9febeb89da6bea9b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:20.596866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc1db6-6990-49f2-9f9a-b9fa1dd5b934 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:20.598521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 421/848] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:20 2022] GET /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b => generated 311 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:20.605001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:20.657599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:20.701094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d878df-11bd-4efc-88ad-e38cb20f0c69 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:20.734295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:20.734942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:20.735222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:20.735496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b/users/20d70cc4251244b780d35ba5e50cce2d/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:20.737629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=e83139dfcee742af9febeb89da6bea9b, user_id=20d70cc4251244b780d35ba5e50cce2d, role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:20.739065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f85d3-8e5e-43bd-8e76-f7723c5437e7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:20.803227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 428/849] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:24:20 2022] PUT /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b/users/20d70cc4251244b780d35ba5e50cce2d/roles/7bcc7d784f624412826cfb09306c7c53 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:24:22.902232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4defa-40d0-45f2-a24c-2a560bff0619 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:22.902779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4defa-40d0-45f2-a24c-2a560bff0619 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:22.902779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4defa-40d0-45f2-a24c-2a560bff0619 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:22.904123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 422/850] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:22.909438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:22.909826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:22.909982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:22.928338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:22.929612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:22.994491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 429/851] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:23.261143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4defa-40d0-45f2-a24c-2a560bff0619 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:23.360601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4defa-40d0-45f2-a24c-2a560bff0619 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:23.376519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:23.393525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:23.394817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:23.394817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:23.394817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] PATH_INFO: `/v3/roles/7bcc7d784f624412826cfb09306c7c53` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:23.396061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] RBAC: Authorizing `identity:get_role(role_id=7bcc7d784f624412826cfb09306c7c53)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:23.397470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:23.398784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 423/852] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:23 2022] GET /identity/v3/roles/7bcc7d784f624412826cfb09306c7c53 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:23.404590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:23.448884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:23.501952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10242a2-6ce2-4f00-852f-9a7b1fd1a28d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:23.534265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:23.534823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:23.535098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:23.535370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] PATH_INFO: `/v3/users/20d70cc4251244b780d35ba5e50cce2d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:23.536465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] RBAC: Authorizing `identity:get_user(user_id=20d70cc4251244b780d35ba5e50cce2d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:23.538244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:23.539780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 430/853] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:23 2022] GET /identity/v3/users/20d70cc4251244b780d35ba5e50cce2d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:23.546000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:23.643951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b57d5a-c9c7-4363-9a30-378f30a30ca3 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:23.677521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:23.678111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:23.678395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:23.678671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:23.847675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:23.862735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:23.864205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:23.958532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 424/854] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:24:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:24:23.965078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:24.061200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a447599-df5e-420b-b656-e661e7e45bf7 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:24.074090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:24.094582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:24.095202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:24.095479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:24.095748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] PATH_INFO: `/v3/projects/e83139dfcee742af9febeb89da6bea9b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:24.096963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] RBAC: Authorizing `identity:get_project(project_id=e83139dfcee742af9febeb89da6bea9b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:24.098471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35706f-1b70-4b48-8ad4-1d134d8bfa7e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:24.100029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 431/855] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:23 2022] GET /identity/v3/projects/e83139dfcee742af9febeb89da6bea9b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:24.106270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:24.185330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:24.201024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea10c30-5b5f-436b-b618-ddc03f7393ae None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:24.233865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:24.234444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:24.234719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:24.234989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:24.235702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] RBAC: Adding query filter params (role.id=7bcc7d784f624412826cfb09306c7c53, scope.project.id=e83139dfcee742af9febeb89da6bea9b, user.id=20d70cc4251244b780d35ba5e50cce2d) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:24.236006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:24.237437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4995ae2-e1d3-4d4e-b1d1-450b261e3714 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:24.242896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 425/856] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:24:24 2022] GET /identity/v3/role_assignments?user.id=20d70cc4251244b780d35ba5e50cce2d&scope.project.id=e83139dfcee742af9febeb89da6bea9b&role.id=7bcc7d784f624412826cfb09306c7c53 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:26.358417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac395d8-28d7-4ceb-a689-d5e4e4a3a79f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:26.358918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac395d8-28d7-4ceb-a689-d5e4e4a3a79f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:26.359010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac395d8-28d7-4ceb-a689-d5e4e4a3a79f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:26.360305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 432/857] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:26.365572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:26.365961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:26.366120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:26.384244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:26.385497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:26.448984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 426/858] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:26.717808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac395d8-28d7-4ceb-a689-d5e4e4a3a79f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:26.816565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac395d8-28d7-4ceb-a689-d5e4e4a3a79f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:26.850389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:26.851007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:26.851286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:26.851554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:26.852647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:26.854195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05425592-c1cf-45b7-8432-9c8c87188651 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:26.855739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 433/859] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:26.861479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:26.934597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:26.955224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efd1f2d-f9f0-480b-b317-9cbd9666a6dd None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:26.988012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:26.988544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:26.988818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:26.989084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:26.989749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:26.991156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ad5d4-cafc-40f9-8c15-ed3857303853 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:27.081042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 427/860] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:24:26 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:29.228825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048723d-9fff-4cbf-bee7-3bfe2c9004b5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:29.229442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048723d-9fff-4cbf-bee7-3bfe2c9004b5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:29.229442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048723d-9fff-4cbf-bee7-3bfe2c9004b5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:29.230763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 434/861] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:29.235877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:29.236307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:29.236406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:29.254174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:29.255349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:29.318408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 428/862] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:29.589701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048723d-9fff-4cbf-bee7-3bfe2c9004b5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:29.638842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:29.688238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048723d-9fff-4cbf-bee7-3bfe2c9004b5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:29.721096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:29.721745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:29.722028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:29.722304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:29.723401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:29.724838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22178e7-367c-4150-875e-f6b807bf3e51 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:29.726434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 435/863] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:24:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:29.732128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:29.789340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:29.829015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c12ab3-edfc-47b8-8a79-47b328d60c64 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:29.862761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:29.863290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:29.863568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:29.863837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:29.864480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:29.865968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577c9f3-780b-40a5-a001-cf7ecdf2dac6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:29.954323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 429/864] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:24:29 2022] POST /identity/v3/users => generated 286 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:32.096473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718c4c-c7fe-4c9a-bbbd-162f8a2a3fa0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:32.097019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718c4c-c7fe-4c9a-bbbd-162f8a2a3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:32.097019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0718c4c-c7fe-4c9a-bbbd-162f8a2a3fa0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:32.098396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 436/865] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:32.103626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:32.104058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:32.104493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:32.122116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:32.123310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:32.188540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 430/866] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:32.454219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0718c4c-c7fe-4c9a-bbbd-162f8a2a3fa0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:32.554104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0718c4c-c7fe-4c9a-bbbd-162f8a2a3fa0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:32.570645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:32.587918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:32.588538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:32.588817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:32.589087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:32.598803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:32.603949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:32.605037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:32.606103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 437/867] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:32.611439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:32.655986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:32.707663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c2885-209d-4422-9a9c-8c67943bbb63 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:32.739907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:32.740521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:32.740797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:32.741065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:32.741823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:32.742124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:32.743485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:32.751953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 431/868] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:32.757543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:32.855180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed235-a73a-4290-bd9c-bf1419325905 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:32.888362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:32.888987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:32.889301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:32.889576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] PATH_INFO: `/v3/users/35c42d29a87c4bc6b43fceb38de03a31` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:32.903191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] RBAC: Authorizing `identity:get_user(user_id=35c42d29a87c4bc6b43fceb38de03a31)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:32.904624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:32.906233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 438/869] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:32 2022] GET /identity/v3/users/35c42d29a87c4bc6b43fceb38de03a31 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:32.911916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:33.009249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05f898b-38de-41da-89b3-82225a8de700 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:33.017540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:33.040623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:33.041758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:33.042054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:33.042365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] PATH_INFO: `/v3/projects/342b00ace3314ec68b4cdf70c64dafb8` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:33.043463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] RBAC: Authorizing `identity:get_project(project_id=342b00ace3314ec68b4cdf70c64dafb8)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:33.044878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb26359-0802-4ac0-8a4d-9d6d2865ee3c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:33.046487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 432/870] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:32 2022] GET /identity/v3/projects/342b00ace3314ec68b4cdf70c64dafb8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:33.052387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:33.085937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:33.149067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4112632e-647f-4143-a376-2c37c9c1975e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:33.182225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:33.182889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:33.183165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:33.183440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] PATH_INFO: `/v3/projects/342b00ace3314ec68b4cdf70c64dafb8/users/35c42d29a87c4bc6b43fceb38de03a31/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:33.185341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] RBAC: Authorizing `identity:create_grant(project_id=342b00ace3314ec68b4cdf70c64dafb8, user_id=35c42d29a87c4bc6b43fceb38de03a31, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:33.186763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04133b8f-dc8f-4010-828e-13f42920b997 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:33.266393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 439/871] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:24:33 2022] PUT /identity/v3/projects/342b00ace3314ec68b4cdf70c64dafb8/users/35c42d29a87c4bc6b43fceb38de03a31/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:24:35.358365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0077e-1820-4cb9-84f1-91a642345be9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:35.363121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0077e-1820-4cb9-84f1-91a642345be9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:35.363121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b0077e-1820-4cb9-84f1-91a642345be9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:35.363121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 433/872] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:35.365756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:35.366129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:35.366307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:35.384269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:35.386183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:35.451265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 440/873] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:35.717630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0077e-1820-4cb9-84f1-91a642345be9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:35.816791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b0077e-1820-4cb9-84f1-91a642345be9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:35.849927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:35.850541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:35.850825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:35.851099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:35.861985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:35.866690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:35.867787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:35.868963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 434/874] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:35.874111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:35.897597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:35.970564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf952d-94d6-4e00-b7bb-6d64b827e8bc None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:36.004083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:36.004677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:36.004952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:36.005321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:36.005990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:36.006296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:36.007654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:36.015491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 441/875] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:36.021296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:36.055558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:36.118995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8edc68-af97-4895-b3a6-39dd7a51334a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:36.151758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:36.152362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:36.152640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:36.152912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] PATH_INFO: `/v3/users/35c42d29a87c4bc6b43fceb38de03a31` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:36.154048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] RBAC: Authorizing `identity:get_user(user_id=35c42d29a87c4bc6b43fceb38de03a31)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:36.155471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:36.157029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 435/876] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:36 2022] GET /identity/v3/users/35c42d29a87c4bc6b43fceb38de03a31 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:36.162639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:36.246246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:36.260094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5531ac7b-3d5c-4095-af7b-022e0bb8eb4e None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:36.292991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:36.293613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:36.293891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:36.294161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:36.359042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:36.360489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:36.447121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:36.461882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 442/877] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:24:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:24:36.468849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:36.564879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43031c07-0868-497f-bf52-a2270dd73c8c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:36.567092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:36.598831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:36.599446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:36.599719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:36.599988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] PATH_INFO: `/v3/projects/342b00ace3314ec68b4cdf70c64dafb8` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:36.601074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] RBAC: Authorizing `identity:get_project(project_id=342b00ace3314ec68b4cdf70c64dafb8)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:36.602513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c47d1-623f-4241-a8e2-fef599a342e8 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:36.604096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 436/878] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:36 2022] GET /identity/v3/projects/342b00ace3314ec68b4cdf70c64dafb8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:36.610121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:36.704248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199bdd7-2e71-406c-a4d7-5f74dd9f2fb2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:36.736421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:36.737004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:36.737307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:36.737577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:36.738283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=342b00ace3314ec68b4cdf70c64dafb8, user.id=35c42d29a87c4bc6b43fceb38de03a31) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:36.738584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:36.739989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6167c2-9f71-4466-b220-02c1c7a914f6 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:36.745555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 443/879] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:24:36 2022] GET /identity/v3/role_assignments?user.id=35c42d29a87c4bc6b43fceb38de03a31&scope.project.id=342b00ace3314ec68b4cdf70c64dafb8&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:38.840922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98963-f31d-4dcc-a889-c6a1bdb9c837 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:38.841507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98963-f31d-4dcc-a889-c6a1bdb9c837 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:38.841507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a98963-f31d-4dcc-a889-c6a1bdb9c837 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:38.842813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 437/880] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:38.847896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807092-328c-488c-8c25-d59e1357b135 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:38.848305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807092-328c-488c-8c25-d59e1357b135 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:38.848441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d807092-328c-488c-8c25-d59e1357b135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:38.866675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8d807092-328c-488c-8c25-d59e1357b135 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:38.867861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8d807092-328c-488c-8c25-d59e1357b135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:38.912162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:38.932515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 444/881] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:39.196816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98963-f31d-4dcc-a889-c6a1bdb9c837 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:39.294116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a98963-f31d-4dcc-a889-c6a1bdb9c837 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:39.327960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:39.328670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:39.328834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:39.329107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:39.329811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:39.331172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefea901-45e3-40bf-9a90-040d65577444 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:39.405025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 438/882] 10.222.0.50 () {60 vars in 1138 bytes} [Wed Oct 12 12:24:39 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:41.540314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8fee-a2c7-426c-9bb4-bd4a9271247e None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:41.540820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8fee-a2c7-426c-9bb4-bd4a9271247e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:41.540905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b8fee-a2c7-426c-9bb4-bd4a9271247e None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:41.542856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 445/883] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:41.547971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:41.548352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:41.548523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:41.566195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:41.567379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:41.592609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:41.632272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 439/884] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:41.897734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8fee-a2c7-426c-9bb4-bd4a9271247e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:41.994876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b8fee-a2c7-426c-9bb4-bd4a9271247e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:42.028501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:42.029142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:42.029431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:42.029708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] PATH_INFO: `/v3/domains/757bace7f5384f438383d1cd27b13d0f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:42.039918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=757bace7f5384f438383d1cd27b13d0f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:42.041393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0077bde3-1bbf-4f30-acac-3e1576de9e98 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:42.042960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 446/885] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Oct 12 12:24:41 2022] GET /identity/v3/domains/757bace7f5384f438383d1cd27b13d0f => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:42.048685 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:42.144660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e508e8-60f8-43e3-ae20-95827e69fc0b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:42.177418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:42.177956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:42.178234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:42.178507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:42.179154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:42.180571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70c0a3-79c6-4f73-a3d9-43dcb4a1febf None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:42.296294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 440/886] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:24:42 2022] POST /identity/v3/projects => generated 361 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:24:44.454310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f4ce-0906-4370-a9db-09a0f47fea31 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:44.454876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f4ce-0906-4370-a9db-09a0f47fea31 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:44.454876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77f4ce-0906-4370-a9db-09a0f47fea31 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:44.456191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 447/887] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:44.461362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:44.461799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:44.461896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:44.480071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:44.481287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:44.490195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:44.545026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 441/888] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:44.816547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77f4ce-0906-4370-a9db-09a0f47fea31 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:44.859062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:44.914249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77f4ce-0906-4370-a9db-09a0f47fea31 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:44.946836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:44.947447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:44.947758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:44.948029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] PATH_INFO: `/v3/domains/757bace7f5384f438383d1cd27b13d0f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:44.949152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] RBAC: Authorizing `identity:get_domain(domain_id=757bace7f5384f438383d1cd27b13d0f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:44.950569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3935cca-7814-4b8a-bf32-f45d3ba6983b None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:44.952099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 448/889] 10.222.0.50 () {56 vars in 1183 bytes} [Wed Oct 12 12:24:44 2022] GET /identity/v3/domains/757bace7f5384f438383d1cd27b13d0f => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:44.957811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:45.052896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b552d7-d456-466f-ae96-8e9288be0dc8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:45.086078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:45.086610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:45.086890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:45.087160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:45.087813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:45.089326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7771e-439d-40d2-8ab8-36a2e51ed959 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:45.196618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:45.201405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 442/890] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:24:44 2022] POST /identity/v3/users => generated 311 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:24:47.351565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0042a-d29a-4cbb-8734-80c33e2c0ce7 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:47.351992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0042a-d29a-4cbb-8734-80c33e2c0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:47.352096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0042a-d29a-4cbb-8734-80c33e2c0ce7 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:47.353502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 449/891] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:47.358617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:47.359007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:47.359161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:47.376841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:47.378068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:47.442362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 443/892] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:47.710032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0042a-d29a-4cbb-8734-80c33e2c0ce7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:47.809176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0042a-d29a-4cbb-8734-80c33e2c0ce7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:47.818007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:47.842268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:47.842887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:47.843170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:47.843448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:47.853227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:47.858526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:47.859660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:24:47.860557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 450/893] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:47.865560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:47.961188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42797d5d-ccc7-41e3-bff0-293ea7e0f4a8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:47.988558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:47.994105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:47.995251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:47.995532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:47.995804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:47.996459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:47.996759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:47.998165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:48.005829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 444/894] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:48.011474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:48.119491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092afe9-5cd3-4fe3-b139-b57f96ed9239 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:48.153143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:48.153789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:48.154067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:48.154340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] PATH_INFO: `/v3/users/2a19e26f595b416dbfc01f7b69c5da71` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:48.167417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=2a19e26f595b416dbfc01f7b69c5da71)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:48.168851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:48.170476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 451/895] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:48 2022] GET /identity/v3/users/2a19e26f595b416dbfc01f7b69c5da71 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:24:48.176298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:48.273806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87403148-1bec-40a6-8e80-b65f1a6c4724 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:48.305391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:48.305958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:48.306237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:48.306507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] PATH_INFO: `/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:48.308140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] RBAC: Authorizing `identity:get_project(project_id=55e49184cd7d4a4bb9d5211673ec1fe6)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:48.309592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447539e-ba3a-4da7-afa1-7129eec3c184 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:48.311172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 445/896] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:48 2022] GET /identity/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:48.317004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:48.344656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:48.416991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a87fb0-0dd6-4951-af29-49ebd886a9f2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:48.450792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:48.451442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:48.451722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:48.451994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] PATH_INFO: `/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6/users/2a19e26f595b416dbfc01f7b69c5da71/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:48.453947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] RBAC: Authorizing `identity:create_grant(project_id=55e49184cd7d4a4bb9d5211673ec1fe6, user_id=2a19e26f595b416dbfc01f7b69c5da71, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:48.455379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cee678-4321-49db-bf7a-3d4fdddb33cb None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:48.518207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 452/897] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:24:48 2022] PUT /identity/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6/users/2a19e26f595b416dbfc01f7b69c5da71/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:24:50.615438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cff16-a44a-4b49-b8d3-467833f0e00d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:50.615966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cff16-a44a-4b49-b8d3-467833f0e00d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:50.615966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889cff16-a44a-4b49-b8d3-467833f0e00d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:50.617348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 446/898] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:24:50.622561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:50.622993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:50.623100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:50.640767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:24:50.641993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:24:50.705796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 453/899] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:24:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:24:50.971979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cff16-a44a-4b49-b8d3-467833f0e00d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.030374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:51.070254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889cff16-a44a-4b49-b8d3-467833f0e00d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.103246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.103857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.104163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.104438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.114675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:24:51.119389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:24:51.120512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:24:51.121713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 447/900] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:24:51.126363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.143740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:51.225075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d554d5-787a-4181-ae84-6422a5bd11c3 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.258180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.258780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.259064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.259340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.259997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:51.260358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:51.262247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:51.270125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 454/901] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:51.275996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.375484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f72cc1-4a0f-46ab-93ad-7ad9c3938747 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.395074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:51.408620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.409273 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.409555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.409826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] PATH_INFO: `/v3/users/2a19e26f595b416dbfc01f7b69c5da71` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.410925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] RBAC: Authorizing `identity:get_user(user_id=2a19e26f595b416dbfc01f7b69c5da71)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:51.412419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:51.414010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 448/902] 10.222.0.50 () {56 vars in 1177 bytes} [Wed Oct 12 12:24:51 2022] GET /identity/v3/users/2a19e26f595b416dbfc01f7b69c5da71 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:51.419910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.497953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:51.518949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07906f4b-666a-491b-b062-d258f6bfa4f2 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.551210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.551810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.552122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.552406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.619554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:51.621605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:51.694828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:24:51.716077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 455/903] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:24:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:24:51.722099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.819053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2824d8-076f-439c-ad00-7420a7ed277a None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.853252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.853882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.854690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.854961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] PATH_INFO: `/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.856058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] RBAC: Authorizing `identity:get_project(project_id=55e49184cd7d4a4bb9d5211673ec1fe6)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:51.857517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b58ea-7446-4719-b49e-1647b0d9d53e None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:51.859141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 449/904] 10.222.0.50 () {56 vars in 1186 bytes} [Wed Oct 12 12:24:51 2022] GET /identity/v3/projects/55e49184cd7d4a4bb9d5211673ec1fe6 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:24:51.865424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:24:51.962158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02332a22-9cbe-41e1-936b-46491cf36e74 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:24:51.995631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:24:51.996220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:24:51.996498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:24:51.996772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:24:51.997516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=55e49184cd7d4a4bb9d5211673ec1fe6, user.id=2a19e26f595b416dbfc01f7b69c5da71) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:24:51.997828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:24:51.999253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee262d20-ef1f-45ae-bc7a-b05672b06436 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:24:52.004846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 456/905] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:24:51 2022] GET /identity/v3/role_assignments?user.id=2a19e26f595b416dbfc01f7b69c5da71&scope.project.id=55e49184cd7d4a4bb9d5211673ec1fe6&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:25:01.849083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=72 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:25:02.002331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=79 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:04.515473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5730e-ab1c-4ec3-8351-4c329e265aec None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:04.516063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5730e-ab1c-4ec3-8351-4c329e265aec None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:04.516063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5730e-ab1c-4ec3-8351-4c329e265aec None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:04.517392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 450/906] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:04.522603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:04.523163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:04.523163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:04.541510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:04.542700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:04.608276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 457/907] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:04.882538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5730e-ab1c-4ec3-8351-4c329e265aec None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:04.982093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5730e-ab1c-4ec3-8351-4c329e265aec None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:05.014496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:05.015120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:05.015402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:05.015674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:05.026516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:05.027961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:05.042653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:05.043864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:05.045054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:05.045054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:05.045054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:05.045054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 451/908] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:05.049920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:05.145225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a55dec-1c1e-4d00-a006-3783003009a0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:05.173957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:05.179741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:05.180132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:05.180414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:05.180712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:05.181383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:05.181691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:05.183058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6864db-3b54-4705-a342-c700990e90e1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:05.194097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 458/909] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:05.200646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:05.253067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:05.300944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce113f68-36ec-4ec4-80ad-14523c19f4ee None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:05.333963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:05.342492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:05.342492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:05.342492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:05.342492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:05.342492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc57593-e7f7-47e2-b338-b1a9cfa69f7f None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:05.419086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 452/910] 10.222.0.50 () {60 vars in 1132 bytes} [Wed Oct 12 12:26:05 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:26:07.568690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e4f1-afac-467c-b283-e8170cb036b1 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:07.569259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e4f1-afac-467c-b283-e8170cb036b1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:07.569259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057e4f1-afac-467c-b283-e8170cb036b1 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:07.570639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 459/911] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:07.576163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:07.576641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:07.576755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:07.594922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:07.596098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:07.661793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 453/912] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:07.930328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057e4f1-afac-467c-b283-e8170cb036b1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.031483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057e4f1-afac-467c-b283-e8170cb036b1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.064789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.065443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.065726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.066007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.076319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:26:08.081057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:08.082182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:08.083063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 460/913] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:26:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 12 12:26:08.088993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.127847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:08.186683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e000-904c-412a-9d31-17cba8ff0e66 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.220832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.221461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.221743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.222015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.222684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] RBAC: Adding query filter params (name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:08.222972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:08.224382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:08.232607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 454/914] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:08.238345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.290028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:08.340553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf1675-597c-484d-ac03-5182e57ebd76 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.372528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.373163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.373472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.373745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.383935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:08.385908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:08.400745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:08.401895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:08.402971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:08.402971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:08.402971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:08.402971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 461/915] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:08.407702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.502188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:08.504931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52957a-6150-4248-b75b-92674a24f335 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.537290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.537879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.538155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.538423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.539051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:08.539347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:08.540690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:08.551750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 455/916] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:08.557990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.660163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabdc83-9145-48e5-8ced-76f576a714c9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.661834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:08.694852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.695474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.695749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.696019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.703714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:08.705170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:26:08.716200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:08.718533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:08.719733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 462/917] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:08.723108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.820462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf410b8-4383-4536-a65b-e286e4a36966 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:08.854642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:08.855244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:08.855527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:08.855801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:08.856515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:08.856821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:08.858384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:08.875660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 456/918] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:08.881433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:08.981214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243b1e6-0d4b-415a-a78d-102255b48fd9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:09.014283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:09.014909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:09.015189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:09.015458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:09.025745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:09.027187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:09.041451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:09.042563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:09.043449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:09.043449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:09.043449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:09.043449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 463/919] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:09.048272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:09.067487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:09.145013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fdcc6-bd15-42e5-b019-5b258e35143b None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:09.178763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:09.179362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:09.179640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:09.179908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:09.180543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:09.180838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:09.182837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:09.193603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 457/920] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:09.199655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:09.215349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:09.300096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ee898-037c-41ef-8970-57b9145e0458 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:09.334291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:09.334953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:09.335229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:09.335500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:09.342352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:09.343813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:26:09.354905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:09.356065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:09.357106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 464/921] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:09.361913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:09.439367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:09.460957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1bc386-1ce7-4086-b14d-ef5b7510e727 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:09.492781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:09.493409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:09.493794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:09.494545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:09.495227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:09.495526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:09.496937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8dd527-8216-4ec4-bfc3-c51a19312294 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:09.508303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 458/922] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:09.514860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:09.590159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:09.613796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621c351-8c55-4801-8814-87493a97bc58 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:09.646969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:09.647627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:09.647907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:09.648187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/b97ffadf3cd944069d1822826ac35e4c/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:09.663167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=b97ffadf3cd944069d1822826ac35e4c, role_id=daa1c0971c5a4e31aa3fd7e0c1ad1def)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:09.664618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145baf89-940a-4636-9272-abc11b778e92 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:09.799470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 465/923] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:26:09 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/b97ffadf3cd944069d1822826ac35e4c/roles/daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:26:11.905433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096637d-d616-4503-82b6-cc9f19e53d4d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:11.905979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096637d-d616-4503-82b6-cc9f19e53d4d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:11.905979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096637d-d616-4503-82b6-cc9f19e53d4d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:11.907341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 459/924] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:11.912699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:11.913085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:11.913285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:11.932320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:11.933567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:11.998910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 466/925] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:12.268889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096637d-d616-4503-82b6-cc9f19e53d4d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:12.371321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096637d-d616-4503-82b6-cc9f19e53d4d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:12.406023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:12.406734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:12.407031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:12.407331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:12.414066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:12.417795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:26:12.422520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:12.423607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:12.424603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 460/926] 10.222.0.50 () {56 vars in 1102 bytes} [Wed Oct 12 12:26:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:12.429675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:12.483315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:12.526784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dd056-5bcb-4d2c-b430-0734517d69de None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:12.559637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:12.560244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:12.560519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:12.560789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:12.561472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:12.561774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:12.563173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:12.570957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 467/927] 10.222.0.50 () {56 vars in 1103 bytes} [Wed Oct 12 12:26:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:12.577737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:12.675072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b9dd4-4c8c-4837-850f-d0e5330d9d67 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:12.713736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:12.714363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:12.714638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:12.714909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:12.725256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:12.726708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:12.740792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:12.741918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:12.743111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:12.743111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:12.743111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:12.743111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 461/928] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:12.748238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:12.846965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc110769-5b84-48a2-adff-5a9f5f1dea39 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:12.863010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:12.880508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:12.881107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:12.881433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:12.881694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:12.882329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:12.882636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:12.884000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:12.895263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 468/929] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:12.901230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:12.950769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:13.000465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a6f52-b91a-4317-bda4-324b63dc7519 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.033550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.034171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.034448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.034719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.042641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.044066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:26:13.054942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:13.056052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:13.057282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 462/930] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:13.062023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:13.160971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9c55d-adec-4784-9ba8-8d263f1d0924 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.194513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.195109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.195384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.195653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.196515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:13.196823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.198277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.215638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 469/931] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Oct 12 12:26:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:13.221571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:13.319064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ffb8f-5a0c-466c-8bb7-7dca8cfe5b42 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.329668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:13.352947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.354192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.354475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.354746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.419706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.421243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.517544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 463/932] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:26:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:26:13.523731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:13.557142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:13.620324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa69ff0-140b-48c1-88af-c70b87fd0194 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.654743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.655400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.655704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.655979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.665973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.670598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:13.681628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:13.682842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:13.683987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:13.683987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:13.683987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:13.683987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 470/933] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:13.688557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:13.701035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:13.787641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc241fc-8f8d-4862-9b44-a92b42d05b41 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.821332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.821930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.822806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.823085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.823723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:13.824025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.825692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.836592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 464/934] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:13.842398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:13.927720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:13.942956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332a00f-1867-4526-8a2b-439265e010f9 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:13.976128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:13.976750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:13.977032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:13.977346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:13.983867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:13.988800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:26:13.996720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:13.997765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:13.998884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 471/935] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:26:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:14.003815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:14.071313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:14.101588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b472bfa1-75ac-4be5-a73e-8aa8ee3accd7 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:14.133441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:14.134032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:14.138420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:14.138420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:14.138420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:14.138420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:14.138420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322e41f-8fda-44dd-b06d-b25cd2499121 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:14.148925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 465/936] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:14.155134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:14.255031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e274441b-010f-4d42-8dfe-73c1ebdf85e1 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:14.288189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:14.288780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:14.289057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:14.289356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:14.290065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] RBAC: Adding query filter params (role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=b97ffadf3cd944069d1822826ac35e4c) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:14.290369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:14.291809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1accaf54-3ff3-4bbd-99ad-5be8d965feab None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:14.297437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 472/937] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:26:14 2022] GET /identity/v3/role_assignments?user.id=b97ffadf3cd944069d1822826ac35e4c&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=daa1c0971c5a4e31aa3fd7e0c1ad1def => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:16.461424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77521-1661-40dc-bad7-dfa64766acd6 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:16.462266 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77521-1661-40dc-bad7-dfa64766acd6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:16.462266 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde77521-1661-40dc-bad7-dfa64766acd6 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:16.464964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 466/938] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:16.470766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:16.471245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:16.471461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:16.492503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:16.493727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:16.497089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:16.558515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 473/939] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:16.829686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde77521-1661-40dc-bad7-dfa64766acd6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:16.929492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde77521-1661-40dc-bad7-dfa64766acd6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:16.957254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:16.962785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:16.963912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:16.964192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:16.964464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:16.974271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:26:16.979586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:16.980604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:16.981600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 467/940] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:26:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:16.986748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.086863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d6b4d-c4d5-4a98-9fa4-94bec8883ad0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.120732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96352-215c-489e-af98-0940d974f4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.121362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96352-215c-489e-af98-0940d974f4df None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.121640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96352-215c-489e-af98-0940d974f4df None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.121908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee96352-215c-489e-af98-0940d974f4df None admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.122556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96352-215c-489e-af98-0940d974f4df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:17.122857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96352-215c-489e-af98-0940d974f4df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.124267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee96352-215c-489e-af98-0940d974f4df None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.132061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 474/941] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:26:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:17.137926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.235417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b3305-8535-48e0-bb3f-044925a65844 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.269378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.269999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.270277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.270543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.280856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.282369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:17.296540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:17.297692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:17.298780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:17.298780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:17.298780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:17.298780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 468/942] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:17.303372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96352-215c-489e-af98-0940d974f4df None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.306291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:17.402284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee96352-215c-489e-af98-0940d974f4df None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.434703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.435269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.435548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.435823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.436455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:17.436758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.438148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.450310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 475/943] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:17.455995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.500961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:17.557343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee47cc-fdee-41f1-a298-25e637ca5df6 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.591487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.592330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.592605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.592876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.600385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.607340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:26:17.612641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:17.613758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:17.615067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 469/944] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:17.620285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.680474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:17.719235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80016196-3d15-4d2e-b3f4-22fdbe57cede None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.752911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.753538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.753820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.754093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.754817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:17.755128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.756596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.774224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 476/945] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:17.779866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:17.877903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77054b4c-9970-444d-bcca-55dd6dedaa44 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:17.879432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:17.911968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:17.912586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:17.912863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:17.913147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:17.923674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:17.925095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:17.941682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:17.942735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:17.943610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:17.943610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:17.943610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:17.943610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 470/946] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:17.946151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:18.045342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4118a-1373-4505-8a9b-f05b50277356 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:18.065686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:18.079515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:18.080121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:18.080402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:18.080677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:18.081355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:18.081664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:18.083058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:18.094044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 477/947] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:18.099814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:18.199474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8c62-d408-45cd-96cc-bc368845a440 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:18.232585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:18.233227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:18.233517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:18.233789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:18.240328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:18.241889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:26:18.253400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:18.254489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:18.255412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 471/948] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:26:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:18.260317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:18.361614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14348f6-fc78-4168-a60e-427098bd9647 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:18.394166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:18.394774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:18.395057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:18.395335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:18.396018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:18.396327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:18.397830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6062d32-69d1-46cc-90bc-2433f5a7c3b8 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:18.410159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 478/949] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:26:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:18.416217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:18.432815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:18.516188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da592790-42e9-4c88-bab4-cf0c5bbb012c None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:18.549666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:18.550311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:18.550588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:18.550857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] PATH_INFO: `/v3/projects/396c3dd232544e709cb8876c985f934c/users/b97ffadf3cd944069d1822826ac35e4c/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:18.552750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] RBAC: Authorizing `identity:create_grant(project_id=396c3dd232544e709cb8876c985f934c, user_id=b97ffadf3cd944069d1822826ac35e4c, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:18.554199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aa18fb-461f-437a-8826-2c0b26f2018a None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:18.649549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 472/950] 10.222.0.50 () {58 vars in 1439 bytes} [Wed Oct 12 12:26:18 2022] PUT /identity/v3/projects/396c3dd232544e709cb8876c985f934c/users/b97ffadf3cd944069d1822826ac35e4c/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:26:20.760123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc2b0-1d13-4179-8876-656306429666 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:20.760715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc2b0-1d13-4179-8876-656306429666 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:20.760715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dc2b0-1d13-4179-8876-656306429666 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:20.762107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 479/951] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:20.767276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818495-6154-49ee-b132-0af603c47d22 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:20.767686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818495-6154-49ee-b132-0af603c47d22 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:20.767823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05818495-6154-49ee-b132-0af603c47d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:20.786232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-05818495-6154-49ee-b132-0af603c47d22 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:20.787420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05818495-6154-49ee-b132-0af603c47d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:20.853422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 473/952] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:21.122211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc2b0-1d13-4179-8876-656306429666 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:21.164638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:21.221005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dc2b0-1d13-4179-8876-656306429666 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:21.253823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a476f-2608-4511-922d-f429159de30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:21.254442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a476f-2608-4511-922d-f429159de30b None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:21.254718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a476f-2608-4511-922d-f429159de30b None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:21.254989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983a476f-2608-4511-922d-f429159de30b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:21.267078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983a476f-2608-4511-922d-f429159de30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-983a476f-2608-4511-922d-f429159de30b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 12 12:26:21.274039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:21.275149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:21.276066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 480/953] 10.222.0.50 () {56 vars in 1096 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:21.278905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818495-6154-49ee-b132-0af603c47d22 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:21.282005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:21.378590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05818495-6154-49ee-b132-0af603c47d22 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:21.411581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:21.412183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:21.412465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:21.412741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:21.413488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:21.413791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:21.415158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:21.422977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 474/954] 10.222.0.50 () {56 vars in 1099 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:21.428968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a476f-2608-4511-922d-f429159de30b None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:21.525333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:21.528325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983a476f-2608-4511-922d-f429159de30b None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:21.561623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:21.562252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:21.562534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:21.562810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:21.572657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:21.575063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:21.589343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:21.590488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:21.591565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:21.591565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:21.591565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:21.591565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 481/955] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:21.596378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:21.661380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:21.696450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85348e68-cf3e-422c-9c5c-80b293e6c022 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:21.730461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:21.731071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:21.731350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:21.731623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:21.732259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:21.732561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:21.733962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:21.745345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 475/956] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:21.751522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:21.850458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c516565-2fac-4a1d-b7fc-65752dbbffa3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:21.884663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:21.885336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:21.885615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:21.885891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:21.892963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:21.894487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 12 12:26:21.905639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:21.912534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:21.913767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 482/957] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:21.914518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.010655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ee0ef-07a2-41e3-8e38-3ead7dc82c11 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.035597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:22.044547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.045164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.045448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.045719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.046431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:22.046736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.048159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.064591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 476/958] 10.222.0.50 () {56 vars in 1143 bytes} [Wed Oct 12 12:26:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:22.070468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.085753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:22.167343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7c3de-1de7-4016-b8fe-7cdf35bff248 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.200964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.201594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.201874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.202148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.266856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.268304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.281807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:22.365885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 483/959] 10.222.0.50 () {58 vars in 1282 bytes} [Wed Oct 12 12:26:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 12 12:26:22.371818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.470048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00d2fc-8f7e-4619-8ff4-0574be75552d None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.502832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.503452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.503777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.504049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.514596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.516042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 12 12:26:22.530887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:22.532025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 12 12:26:22.533150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 12 12:26:22.533150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 12 12:26:22.533150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:22.533150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 477/960] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:22.537916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.634926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea53dd-5c0b-4b5b-aad2-ebb9a3faed39 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.647648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:22.668064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.668663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.668939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.669239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.670105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:22.670524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.671964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.683500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 484/961] 10.222.0.50 () {56 vars in 1109 bytes} [Wed Oct 12 12:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:22.689221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.726910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:22.790614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1b590f-5906-48b3-81ad-b91a569931ac None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.824459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.825402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.825678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.825948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.832431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.833878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 12 12:26:22.844819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:22.845889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: ERROR keystone.server.flask.application Oct 12 12:26:22.846976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 478/962] 10.222.0.50 () {56 vars in 1111 bytes} [Wed Oct 12 12:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:22.851866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:22.950842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba67f46-dbd1-4f1d-bda9-9576c5b37541 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:22.983359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:22.983897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:22.984174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:22.984465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:22.985151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:22.985471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:22.986898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca5f85-cd67-4494-baf6-e0fae39b3c7a None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:22.998528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 485/963] 10.222.0.50 () {56 vars in 1148 bytes} [Wed Oct 12 12:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:23.004734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:23.099441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:23.105226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4ec98-0145-4886-954f-0aba781a4773 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:23.138304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:23.138901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:23.139182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:23.139453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:23.140176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] RBAC: Adding query filter params (role.id=66e345ff9b6440f2bda44a6d1bb98077, scope.project.id=396c3dd232544e709cb8876c985f934c, user.id=b97ffadf3cd944069d1822826ac35e4c) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:23.140476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:23.141930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cb48ca-c850-43ea-8edf-6fad5a946a12 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:23.147638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 479/964] 10.222.0.50 () {56 vars in 1374 bytes} [Wed Oct 12 12:26:23 2022] GET /identity/v3/role_assignments?user.id=b97ffadf3cd944069d1822826ac35e4c&scope.project.id=396c3dd232544e709cb8876c985f934c&role.id=66e345ff9b6440f2bda44a6d1bb98077 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:25.274447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccb0e-734e-4f31-a5b1-cd4ff9d36ced None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:25.274971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccb0e-734e-4f31-a5b1-cd4ff9d36ced None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:25.274971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcccb0e-734e-4f31-a5b1-cd4ff9d36ced None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:25.276488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 486/965] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:25.282446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:25.282873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:25.283007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:25.301692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:25.302903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:25.369491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 480/966] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:25.642552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcccb0e-734e-4f31-a5b1-cd4ff9d36ced None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:25.674114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:25.741943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcccb0e-734e-4f31-a5b1-cd4ff9d36ced None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:25.776079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:25.778986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:25.778986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:25.778986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:25.778986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:25.779334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:25.787948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:25.789271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:25.790331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 487/967] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:26:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:25.795179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:25.883859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:25.893955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94588b60-8f78-41a3-84eb-3237e19efc7e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:25.926183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:25.926776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:25.927055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:25.927352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:25.927969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:25.928344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:25.929742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529f4f6-55d3-45cd-a963-005fd178f746 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:25.934926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 481/968] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Oct 12 12:26:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:25.940859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:26.033721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:26.039074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095017-4814-45eb-93ac-c73d35d95ba3 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:26.071610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:26.072214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:26.072497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:26.072777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] PATH_INFO: `/v3/services` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:26.073446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] RBAC: Adding query filter params (type=placement) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:26.073756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:26.075937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4fb846-5505-454d-b9c9-12116749cdbd None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:26.084769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 488/969] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Oct 12 12:26:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:28.184120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af650a-5fb0-416c-b394-babe9a20913c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:28.184676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af650a-5fb0-416c-b394-babe9a20913c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:28.184676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af650a-5fb0-416c-b394-babe9a20913c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:28.186034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 482/970] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:28.191282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c321-a173-4bf5-a604-4317ceb45025 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:28.191695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c321-a173-4bf5-a604-4317ceb45025 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:28.191831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626c321-a173-4bf5-a604-4317ceb45025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:28.210154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1626c321-a173-4bf5-a604-4317ceb45025 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:28.211345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1626c321-a173-4bf5-a604-4317ceb45025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:28.276261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 489/971] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:28.546903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af650a-5fb0-416c-b394-babe9a20913c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:28.647025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af650a-5fb0-416c-b394-babe9a20913c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:28.680798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:28.681418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:28.681703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:28.681972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:28.682631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:28.684003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3f318-e2cf-41cc-94f0-72b0db0cdf72 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:28.779832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 483/972] 10.222.0.50 () {60 vars in 1141 bytes} [Wed Oct 12 12:26:28 2022] POST /identity/v3/services => generated 246 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:26:30.927248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17c93-50d9-43a4-bfab-0956272b513c None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:30.927798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17c93-50d9-43a4-bfab-0956272b513c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:30.927798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df17c93-50d9-43a4-bfab-0956272b513c None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:30.929289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 490/973] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:30.934656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:30.935080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:30.940245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:30.953798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:30.954982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:30.964124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:31.027434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 484/974] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:30 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:31.292274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17c93-50d9-43a4-bfab-0956272b513c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:31.387305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:31.397797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df17c93-50d9-43a4-bfab-0956272b513c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:31.430543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:31.431178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:31.431463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:31.431741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:31.432326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:31.434379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:31.442925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:31.444081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:31.445384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 491/975] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:26:31 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:31.450059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:31.550170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f2410-3e8a-4e65-a880-2cced96ca9d2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:31.584327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:31.584946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:31.585261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:31.585540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:31.586199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:31.586565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:31.587978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:31.594305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 485/976] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Oct 12 12:26:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:26:31.600420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:31.715783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ab5f18-5b1f-451e-8dab-8b99a376ae19 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:31.752167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:31.752788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:31.753071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:31.753391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:31.754101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] RBAC: Adding query filter params (interface=public, service_id=55de24f9a82d4fc2a65a968dd69be7dd, region_id=RegionOne) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:31.754412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:31.755809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382e1e0c-ffff-4a3c-bafb-251bfd5dd752 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:31.761423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 492/977] 10.222.0.50 () {56 vars in 1251 bytes} [Wed Oct 12 12:26:31 2022] GET /identity/v3/endpoints?service_id=55de24f9a82d4fc2a65a968dd69be7dd&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:26:31.767311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:31.771335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:31.879636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94bef4-94d7-48ef-b5df-9593af981920 None admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:31.913989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:31.914633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:31.914910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:31.915179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:31.915773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:31.917146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de078ac3-9446-452e-897b-8a3ea56a20c0 None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:31.924458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 486/978] 10.222.0.50 () {56 vars in 1087 bytes} [Wed Oct 12 12:26:31 2022] GET /identity/v3/services => generated 2191 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:26:34.071301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402254-90d3-4ba8-8dd5-90e3bfe76436 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:34.071830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402254-90d3-4ba8-8dd5-90e3bfe76436 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:34.071830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33402254-90d3-4ba8-8dd5-90e3bfe76436 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:34.073366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 493/979] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:26:34.079424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:34.079836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:34.079960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:34.097978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:26:34.099174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:26:34.159100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:34.164453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 487/980] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:26:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 12 12:26:34.434957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33402254-90d3-4ba8-8dd5-90e3bfe76436 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:34.454559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:34.534935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33402254-90d3-4ba8-8dd5-90e3bfe76436 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:34.568292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:34.568905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:34.569206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:34.569477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:34.570047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:34.571396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 12 12:26:34.580249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 12 12:26:34.581576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.get_or_create( Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application with Lock( Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self._enter() Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application return self.creator() Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application created_value = creator( Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: ERROR keystone.server.flask.application Oct 12 12:26:34.582704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 494/981] 10.222.0.50 () {56 vars in 1117 bytes} [Wed Oct 12 12:26:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 12 12:26:34.587310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:34.684708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b86b10-7692-4f6f-8370-221ef603c5d6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:34.717934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:34.718534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:34.718813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:34.719083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] PATH_INFO: `/v3/services` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:34.719699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:26:34.719999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:34.721447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de449936-dba7-40b8-9cef-11b3d4b8923d None admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:34.726547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 488/982] 10.222.0.50 () {56 vars in 1116 bytes} [Wed Oct 12 12:26:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:26:34.732911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:26:34.815175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:34.832636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c1a0-da09-460d-97b9-24c104f0fbf0 None admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:26:34.866807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:26:34.867434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:26:34.867720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:26:34.867995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:26:34.868668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:26:34.870064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f39fa5-7fe2-4ce0-bfc9-18599284787f None admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:26:34.959384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 495/983] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:26:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:26:44.723504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=69 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:26:44.954883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:51.189057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ffd4e-a660-40eb-8e91-70174ac4bf6b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:51.189587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ffd4e-a660-40eb-8e91-70174ac4bf6b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:51.189664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ffd4e-a660-40eb-8e91-70174ac4bf6b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:51.190998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 489/984] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:32:51.196640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd41bf6-d431-4cc4-b931-5d23871741a4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:51.197043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd41bf6-d431-4cc4-b931-5d23871741a4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:51.197043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd41bf6-d431-4cc4-b931-5d23871741a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:51.282498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-abd41bf6-d431-4cc4-b931-5d23871741a4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:51.283738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-abd41bf6-d431-4cc4-b931-5d23871741a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:51.425593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 496/985] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:51.705482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:51.705819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:51.706037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:51.707449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 490/986] 10.222.0.50 () {54 vars in 964 bytes} [Wed Oct 12 12:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:32:51.713335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38e47-05ad-4320-a09b-271464d3cc7b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:51.713760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38e47-05ad-4320-a09b-271464d3cc7b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:51.714138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a38e47-05ad-4320-a09b-271464d3cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:51.798486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c7a38e47-05ad-4320-a09b-271464d3cc7b None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:51.799630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c7a38e47-05ad-4320-a09b-271464d3cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:51.823442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:51.883719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 497/987] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Oct 12 12:32:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:51.893014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:51.894925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:52.011646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1c6c9-79e4-42db-91a2-581bf6fcd76c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:52.097567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:52.098197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:52.098478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:52.098751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:52.100985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:52.164295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:52.224087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:52.226072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50451d5d-b064-45fe-ae6d-39a8d42b3547 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:52.246641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 491/988] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:54.682718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:54.683154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:54.683288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:54.684730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 498/989] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:32:54.689942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246b0a-643e-45ef-b091-152d0ae2e186 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:54.690375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246b0a-643e-45ef-b091-152d0ae2e186 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:54.690543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a246b0a-643e-45ef-b091-152d0ae2e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:54.762166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2a246b0a-643e-45ef-b091-152d0ae2e186 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:54.763382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2a246b0a-643e-45ef-b091-152d0ae2e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:54.858698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 492/990] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:55.135642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:55.137207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:55.237751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0118c6c-809d-4f9c-814a-5afdccf56383 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:55.310085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:55.312088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:55.312754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:55.313027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:55.313329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:55.314928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:55.427044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:55.428941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd283aa1-7483-4f93-8891-1b5a9e9aa937 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:55.447927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 499/991] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:32:58.120331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:58.120922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:58.120922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:58.122246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 493/992] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:32:58.127509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9c8d-3051-4b5c-be29-44c521965c04 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:58.127901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9c8d-3051-4b5c-be29-44c521965c04 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:58.128064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e9c8d-3051-4b5c-be29-44c521965c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:58.193232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a74e9c8d-3051-4b5c-be29-44c521965c04 None None] MFA Rules not processed for user `ca323088effc4beea6a3403c776de383`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:32:58.194446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a74e9c8d-3051-4b5c-be29-44c521965c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:58.245441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:58.289199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 500/993] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:32:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:32:58.570066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:32:58.571605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:58.581329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:58.672774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bf9e0-fa8f-4972-b4af-a84e41cc6c8c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:32:58.746123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:32:58.746715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:32:58.746987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:32:58.747251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:32:58.748822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:32:58.809514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:58.857194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:32:58.858644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2892e6dd-8956-4a81-a813-d19518ff53d5 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:32:58.876839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 494/994] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:32:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:01.718112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:01.718710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:01.718710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:01.720049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 501/995] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:01.725364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b69219-da49-42c9-ae23-d9f85528a743 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:01.725833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b69219-da49-42c9-ae23-d9f85528a743 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:01.725937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b69219-da49-42c9-ae23-d9f85528a743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:01.791170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f6b69219-da49-42c9-ae23-d9f85528a743 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:01.792388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f6b69219-da49-42c9-ae23-d9f85528a743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:01.887175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 495/996] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:02.171386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:02.173096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:02.276394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c017651c-db27-4210-8b08-554a5c19e70d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:02.350459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:02.351083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:02.351357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:02.351628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:02.353260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:02.360073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:02.460992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:02.462383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975bed5-f121-4d6a-a968-f234e638c87b service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:02.480447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 502/997] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:05.622682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:05.623217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:05.623217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:05.624573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 496/998] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:05.629784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75cb55-6289-42a3-b7d6-1d6ba042d9f9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:05.630202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75cb55-6289-42a3-b7d6-1d6ba042d9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:05.630481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75cb55-6289-42a3-b7d6-1d6ba042d9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:05.698205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-0a75cb55-6289-42a3-b7d6-1d6ba042d9f9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:05.699420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0a75cb55-6289-42a3-b7d6-1d6ba042d9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:05.758298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:05.801795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 503/999] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:06.086255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:06.087809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:06.107648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:06.192494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a588f749-f81a-45a7-97ca-c0b3a0b0afca None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:06.267523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:06.268247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:06.268535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:06.268803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:06.270490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:06.346913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:06.385940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:06.387377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa29439-17a5-48d7-ae53-d810d482d69f service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:06.405689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 497/1000] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:08.668028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:08.668582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:08.668582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:08.670129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 504/1001] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:08.675238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f5b1-00e3-4450-8b05-31facfb66809 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:08.675639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f5b1-00e3-4450-8b05-31facfb66809 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:08.675790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97f5b1-00e3-4450-8b05-31facfb66809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:08.743604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ec97f5b1-00e3-4450-8b05-31facfb66809 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:08.744831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ec97f5b1-00e3-4450-8b05-31facfb66809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:08.851507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 498/1002] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:09.131036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:09.132588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:09.237516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e398999-befd-432b-9bb8-653e3dcc4ae9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:09.313328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:09.313945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:09.314223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:09.314495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:09.316382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:09.338684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:09.432830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:09.434343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ece267-afe4-4ab1-a4b5-473273179eaf service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:09.452996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 505/1003] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:11.644447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:11.644949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:11.644949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:11.646286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 499/1004] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:11.652150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3fe7-99d7-4f29-ba0a-fde7b5d97334 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:11.652548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3fe7-99d7-4f29-ba0a-fde7b5d97334 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:11.652695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecf3fe7-99d7-4f29-ba0a-fde7b5d97334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:11.721659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4ecf3fe7-99d7-4f29-ba0a-fde7b5d97334 None None] MFA Rules not processed for user `ca323088effc4beea6a3403c776de383`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:11.722910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4ecf3fe7-99d7-4f29-ba0a-fde7b5d97334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:11.789727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:11.821934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 506/1005] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:12.103126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:12.104682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:12.137761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:12.214064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3300a8-22b3-410f-b890-7b332f03194b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:12.288827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:12.289468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:12.289748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:12.290019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:12.291617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:12.371443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:12.402910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:12.404360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc00f22-e9bb-45d2-b72f-8ff268075091 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:12.422833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 500/1006] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:12 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:14.993262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:14.993760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:14.993760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:14.995103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 507/1007] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:15.000407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b324e-e652-4f27-8c65-7e129893020d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:15.000827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b324e-e652-4f27-8c65-7e129893020d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:15.000965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b324e-e652-4f27-8c65-7e129893020d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:15.067490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-375b324e-e652-4f27-8c65-7e129893020d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:15.069335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-375b324e-e652-4f27-8c65-7e129893020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:15.165130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 501/1008] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:15.454288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:15.455833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:15.557628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fdcb8-705d-4ddc-b429-2506a17c1031 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:15.629999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:15.630609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:15.630912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:15.631186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:15.632782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:15.659540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:15.740362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:15.741809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5189f-b574-4e2f-bd6c-03bf9c6e7157 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:15.759654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 508/1009] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:17.936320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:17.936851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:17.936969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:17.938292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 502/1010] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:17.944214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d4997-e9c8-4528-a09c-2ac445c528f9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:17.944634 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d4997-e9c8-4528-a09c-2ac445c528f9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:17.944769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d4997-e9c8-4528-a09c-2ac445c528f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:18.012017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7c5d4997-e9c8-4528-a09c-2ac445c528f9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:18.013277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7c5d4997-e9c8-4528-a09c-2ac445c528f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:18.088186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:18.109885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 509/1011] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:18.394647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:18.396179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:18.436191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:18.497733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8373832-717d-4c8e-9c0d-31b4f93177a1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:18.569356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:18.569947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:18.570221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:18.570488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:18.572053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:18.653714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:18.678934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:18.680514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d02e1-2807-4218-92ae-4b149b460670 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:18.699777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 503/1012] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:21.354391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b4ed-85d5-4a0c-b84f-314d61bb6018 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.354842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b4ed-85d5-4a0c-b84f-314d61bb6018 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.354935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75b4ed-85d5-4a0c-b84f-314d61bb6018 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.356414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 510/1013] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:21.361594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0826466-b6c2-4f4c-9240-cc67778474d2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.362036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0826466-b6c2-4f4c-9240-cc67778474d2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.362127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0826466-b6c2-4f4c-9240-cc67778474d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.426813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c0826466-b6c2-4f4c-9240-cc67778474d2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:21.428052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c0826466-b6c2-4f4c-9240-cc67778474d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:21.528960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 504/1014] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:21.828581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.828888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.829204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.830579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 511/1015] 10.222.0.50 () {54 vars in 964 bytes} [Wed Oct 12 12:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:33:21.836991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b0cc-a29d-4109-8273-57cd4e5eff4d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:21.837297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b0cc-a29d-4109-8273-57cd4e5eff4d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:21.837571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942b0cc-a29d-4109-8273-57cd4e5eff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:21.891546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:21.913626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d942b0cc-a29d-4109-8273-57cd4e5eff4d None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:21.914836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d942b0cc-a29d-4109-8273-57cd4e5eff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:21.989654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 505/1016] 10.222.0.50 () {58 vars in 1061 bytes} [Wed Oct 12 12:33:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:21.998927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:22.000481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:22.105097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898da371-5043-4dd9-8815-6fa26c4c17a8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:22.176973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:22.177514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:22.177790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:22.178059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:22.179640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:22.214912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:22.286172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:22.287604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155a9f4-a0de-4e85-ae12-8952e99c57ad service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:22.305737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 512/1017] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:27.230694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:27.231286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:27.231286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:27.232601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 506/1018] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:27.237879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f68e-3361-4789-b32f-d7d4ae63a345 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:27.238318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f68e-3361-4789-b32f-d7d4ae63a345 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:27.238411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1f68e-3361-4789-b32f-d7d4ae63a345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:27.305734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-52f1f68e-3361-4789-b32f-d7d4ae63a345 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:27.307225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-52f1f68e-3361-4789-b32f-d7d4ae63a345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:27.398829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:27.409811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 513/1019] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:27.697013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:27.698675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:27.803168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741ca77-333e-4dae-963d-96e56079ee9b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:27.843674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:27.879277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:27.879881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:27.880155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:27.880421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:27.883419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:27.994515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:27.995871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa6aaf-cb01-47d1-96ea-8f767e852f1e service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:28.015136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 507/1020] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:31.127624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:31.128196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:31.128196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:31.129577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 514/1021] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:31.135043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465084c-fd1e-4739-be85-ddda3145f48a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:31.135443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465084c-fd1e-4739-be85-ddda3145f48a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:31.135729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465084c-fd1e-4739-be85-ddda3145f48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:31.202351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1465084c-fd1e-4739-be85-ddda3145f48a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:31.203556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1465084c-fd1e-4739-be85-ddda3145f48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:31.222243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:31.302377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 508/1022] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:31.581864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:31.583404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:31.686867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beb8da-d9f6-465a-8cc8-4136e3242e21 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:31.778374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:31.778986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:31.779260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:31.779527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:31.781110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:31.829183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:31.899079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:31.900624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e454f087-383a-4928-82f0-cceaa8163ad0 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:31.920664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 515/1023] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:36.162457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:36.162897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:36.163015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:36.164397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 509/1024] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:36.170036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a949b4-b92d-40c3-bc17-7f6f64498ce2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:36.170476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a949b4-b92d-40c3-bc17-7f6f64498ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:36.170606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a949b4-b92d-40c3-bc17-7f6f64498ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:36.242146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-49a949b4-b92d-40c3-bc17-7f6f64498ce2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:36.243360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-49a949b4-b92d-40c3-bc17-7f6f64498ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:36.345387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:36.348305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 516/1025] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:36.629309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:36.630865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:36.735705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede379d4-204b-4b1b-abdc-1f4d1b78c546 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:36.789074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:36.814691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:36.817301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:36.817301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:36.817301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:36.817878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:36.933442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:36.934913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d022fd4-43f3-44d9-9f08-120e852b503f service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:36.954201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 510/1026] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:41.796930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe833-7d57-4f1f-9acf-5ea385fe622e None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:41.797602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe833-7d57-4f1f-9acf-5ea385fe622e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:41.797602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fe833-7d57-4f1f-9acf-5ea385fe622e None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:41.800028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 517/1027] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:33:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:41.805112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50553-f269-455e-a520-8c8922c28f54 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:41.805112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50553-f269-455e-a520-8c8922c28f54 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:41.805600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d50553-f269-455e-a520-8c8922c28f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:41.909995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-62d50553-f269-455e-a520-8c8922c28f54 None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:41.911240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-62d50553-f269-455e-a520-8c8922c28f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:41.954835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:42.069313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 511/1028] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:33:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:33:46.136529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916d65-ef45-4960-b8fd-25938ce88e79 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:46.137085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916d65-ef45-4960-b8fd-25938ce88e79 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:46.137085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b916d65-ef45-4960-b8fd-25938ce88e79 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:46.138461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 518/1029] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:46.146980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff3710-d4e9-4e2b-88cc-5ecc91fff45f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:46.147423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff3710-d4e9-4e2b-88cc-5ecc91fff45f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:46.147535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff3710-d4e9-4e2b-88cc-5ecc91fff45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:46.226059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8bff3710-d4e9-4e2b-88cc-5ecc91fff45f None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:46.227279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8bff3710-d4e9-4e2b-88cc-5ecc91fff45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:46.304820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:46.346943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 512/1030] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:33:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:47.786245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bed82-7454-49b7-9ddc-259f92dab755 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:47.787316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bed82-7454-49b7-9ddc-259f92dab755 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:47.787316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1bed82-7454-49b7-9ddc-259f92dab755 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:47.788770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 519/1031] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:47.794131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b552-0d2a-411f-95be-854900aac8af None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:47.794581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b552-0d2a-411f-95be-854900aac8af None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:47.794674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10b552-0d2a-411f-95be-854900aac8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:47.873865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9b10b552-0d2a-411f-95be-854900aac8af None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:47.875076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9b10b552-0d2a-411f-95be-854900aac8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:47.983834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 513/1032] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:33:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:33:51.572670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8375b-026e-49eb-9230-ec953382944a None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:51.573972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8375b-026e-49eb-9230-ec953382944a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:51.574771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8375b-026e-49eb-9230-ec953382944a None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:51.576265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 520/1033] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:51.582293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410bf1-fb80-4b05-858e-3098cd3ccf40 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:51.582718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410bf1-fb80-4b05-858e-3098cd3ccf40 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:51.583057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8410bf1-fb80-4b05-858e-3098cd3ccf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:51.626135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:51.658791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a8410bf1-fb80-4b05-858e-3098cd3ccf40 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:51.660129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a8410bf1-fb80-4b05-858e-3098cd3ccf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:51.766672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 514/1034] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:52.068928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:52.069672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:52.074112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:52.074112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 521/1035] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:33:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:52.081550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9446e-7820-4a96-9376-27a295a89b75 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:52.082311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9446e-7820-4a96-9376-27a295a89b75 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:52.083012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9446e-7820-4a96-9376-27a295a89b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:52.182348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9bf9446e-7820-4a96-9376-27a295a89b75 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:52.184076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9bf9446e-7820-4a96-9376-27a295a89b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:52.242180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:52.315745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 515/1036] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:33:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:33:52.324172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:52.326070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:52.481036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806811ef-f870-4912-a589-36da755b7ec6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:52.557647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:52.602045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:52.602751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:52.603101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:52.603382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:52.605204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:52.710412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:52.712012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02cf22-f454-4304-b313-4fe60f6e17e3 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:52.731384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 522/1037] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:55.127880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:55.128340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:55.128672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:55.134353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 516/1038] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:55.135861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074361a-82ef-4b6b-bd5d-88b61c1389de None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:55.135861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074361a-82ef-4b6b-bd5d-88b61c1389de None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:55.136307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074361a-82ef-4b6b-bd5d-88b61c1389de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:55.210432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c074361a-82ef-4b6b-bd5d-88b61c1389de None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:55.211751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c074361a-82ef-4b6b-bd5d-88b61c1389de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:55.255126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:55.331100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 523/1039] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:55.608474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:55.610215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:55.803502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ccb25-f0f1-4f5d-84e4-82524b62550c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:55.815614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:55.934866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:55.935478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:55.935785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:55.936057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:55.937704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:56.032315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:56.033992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3a44f-a4cb-4ae7-a74c-5bf3f442553c service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:56.054078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 517/1040] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:58.722709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e75b0-354a-4bb2-bfea-400d2df30c4f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:58.723184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e75b0-354a-4bb2-bfea-400d2df30c4f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:58.723291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e75b0-354a-4bb2-bfea-400d2df30c4f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:58.724819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 524/1041] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:58.729943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75343ac-59b4-490d-9024-e4c155fdcf16 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:58.730365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75343ac-59b4-490d-9024-e4c155fdcf16 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:58.730547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75343ac-59b4-490d-9024-e4c155fdcf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:58.747426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:58.801622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a75343ac-59b4-490d-9024-e4c155fdcf16 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:58.803394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a75343ac-59b4-490d-9024-e4c155fdcf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:58.904732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 518/1042] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:33:59.196276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:59.196578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:59.196832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:59.198323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 525/1043] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:59.204955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3441-9d5f-4793-8ac3-badbf89ae145 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:59.205377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3441-9d5f-4793-8ac3-badbf89ae145 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:59.205809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd3441-9d5f-4793-8ac3-badbf89ae145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:59.285562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7ffd3441-9d5f-4793-8ac3-badbf89ae145 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:59.286981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7ffd3441-9d5f-4793-8ac3-badbf89ae145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:59.333106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:59.415790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 519/1044] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:33:59.423763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:33:59.425435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:59.579574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff70f-058c-4181-a593-cdcc417f27a8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:33:59.602516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:59.708024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:33:59.708827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:59.709110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:59.709414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:59.711027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:59.764338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1cd31-e512-4b9c-8a26-f7fe26fa482e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:59.764893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1cd31-e512-4b9c-8a26-f7fe26fa482e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:59.764993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1cd31-e512-4b9c-8a26-f7fe26fa482e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:59.766645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 520/1045] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:33:59.772064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f762f-39e1-4b6f-9096-1c2f2fc3c773 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:33:59.772351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f762f-39e1-4b6f-9096-1c2f2fc3c773 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:33:59.772625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f762f-39e1-4b6f-9096-1c2f2fc3c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:33:59.812107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:33:59.813841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed63ddf8-fc97-424e-83f6-1dd0bbeaa572 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:33:59.833765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 526/1046] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:33:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:33:59.843946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7c2f762f-39e1-4b6f-9096-1c2f2fc3c773 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:33:59.845444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7c2f762f-39e1-4b6f-9096-1c2f2fc3c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:33:59.946904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:33:59.956116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 521/1047] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:33:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:34:00.292844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:00.292844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:00.292844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:00.295422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 527/1048] 10.222.0.50 () {54 vars in 963 bytes} [Wed Oct 12 12:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:00.299009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08557b-4f28-4071-8217-25fc036509b5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:00.299426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08557b-4f28-4071-8217-25fc036509b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:00.299802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c08557b-4f28-4071-8217-25fc036509b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:00.388117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2c08557b-4f28-4071-8217-25fc036509b5 None None] MFA Rules not processed for user `4a804dd78ed44695afad6616ac504d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:00.389403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2c08557b-4f28-4071-8217-25fc036509b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:00.473201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 522/1049] 10.222.0.50 () {58 vars in 1060 bytes} [Wed Oct 12 12:34:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:00.481559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:00.483137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:00.517346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:00.601704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19854fa4-731b-4abe-9f24-279c200a9de5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:00.687872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:00.688588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:00.689071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:00.689316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:00.691391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:00.777911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:00.819449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:00.821938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c4de4-8744-4be7-a098-df0c2afd7e18 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:00.846826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 528/1050] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:34:02.202525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:02.203070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:02.203070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:02.204402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 523/1051] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:02.209589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05214-fe50-4f08-a587-d741ef509ab8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:02.210027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05214-fe50-4f08-a587-d741ef509ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:02.210124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd05214-fe50-4f08-a587-d741ef509ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:02.277528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5fd05214-fe50-4f08-a587-d741ef509ab8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:02.278748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5fd05214-fe50-4f08-a587-d741ef509ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:02.380298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 529/1052] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:02.669338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:02.670883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:02.761717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:02.826893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1926e17d-7939-4bdc-8575-eb300830a439 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:02.946364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:02.946980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:02.947259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:02.947528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:02.949158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:03.002678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:03.045963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:03.047666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342b5983-bd18-4723-b961-de3212bb48e3 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:03.067596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 524/1053] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:05.420233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:05.420755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:05.420843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:05.422374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 530/1054] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:05.427395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f94b3-a92a-47c8-a597-8faf590a409c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:05.427787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f94b3-a92a-47c8-a597-8faf590a409c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:05.427974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f94b3-a92a-47c8-a597-8faf590a409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:05.495874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c89f94b3-a92a-47c8-a597-8faf590a409c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:05.497167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c89f94b3-a92a-47c8-a597-8faf590a409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:05.600437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 525/1055] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:05.895329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:05.897536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:05.937452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:06.054750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0328b-03f9-4308-bc6a-c0805e89f7c9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:06.177876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:06.184326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:06.184954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:06.185259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:06.185531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:06.193679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:06.282644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:06.284233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40b657-291a-4d87-a526-8663bb9c6f0a service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:06.303930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 531/1056] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:08.652194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:08.652761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:08.652761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:08.654180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 526/1057] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:08.659957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439df3-93c4-470d-9874-2210c3db316d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:08.660412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439df3-93c4-470d-9874-2210c3db316d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:08.660679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe439df3-93c4-470d-9874-2210c3db316d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:08.735710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fe439df3-93c4-470d-9874-2210c3db316d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:08.737022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe439df3-93c4-470d-9874-2210c3db316d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:08.804959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:08.837367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 532/1058] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:09.132179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:09.133887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.164967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:09.298222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6be1c-72e8-4ea5-96aa-b0e85c9b694e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:09.403176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:09.420216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:09.420840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:09.421163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:09.421447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:09.423108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:09.521230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:09.522892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378cb10-adcf-438d-a084-99b84034c5b7 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:09.541885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 527/1059] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:11.921970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:11.922632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:11.922632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:11.923786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 533/1060] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:11.929084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9beab8-679d-45c3-b3ff-257699370246 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:11.929550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9beab8-679d-45c3-b3ff-257699370246 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:11.929721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9beab8-679d-45c3-b3ff-257699370246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:12.011334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ed9beab8-679d-45c3-b3ff-257699370246 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:12.012901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ed9beab8-679d-45c3-b3ff-257699370246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:12.077146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:12.118034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 528/1061] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:12.406229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:12.407757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:12.608907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b387b-c765-42d3-b381-322f12b2f6b6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:12.684926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:12.760863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:12.761726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:12.762204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:12.762566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:12.765328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:12.887620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:12.889263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba65b7-b541-414e-aedd-821b978d30e8 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:12.908062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 534/1062] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:15.137909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:15.138473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:15.138473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:15.139816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 529/1063] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:15.145046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b649fd-8f21-441b-b765-5ceb05e8f33f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:15.145504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b649fd-8f21-441b-b765-5ceb05e8f33f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:15.145652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b649fd-8f21-441b-b765-5ceb05e8f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:15.213078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b1b649fd-8f21-441b-b765-5ceb05e8f33f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:15.214303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b1b649fd-8f21-441b-b765-5ceb05e8f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:15.222481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:15.313049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 535/1064] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:15.607348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:15.608985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:15.756746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029f26-e803-4d27-8b75-bdf0c2c5995a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:15.801550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:15.868513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:15.869030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:15.869336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:15.869639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:15.871260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:15.963461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:15.966036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffcbf5-bae8-48fb-a41f-2eae1d16874e service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:15.983100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 530/1065] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:16.399298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe3a5-0d3e-42ca-ab03-c6cc618fe4aa None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:16.399832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe3a5-0d3e-42ca-ab03-c6cc618fe4aa None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:16.399832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fe3a5-0d3e-42ca-ab03-c6cc618fe4aa None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:16.401296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 536/1066] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:16.406277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c491-e6cb-40e8-9113-1ff4d8bd2bbd None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:16.406704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c491-e6cb-40e8-9113-1ff4d8bd2bbd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:16.406816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c491-e6cb-40e8-9113-1ff4d8bd2bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:16.470486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:16.473213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8ad3c491-e6cb-40e8-9113-1ff4d8bd2bbd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:16.475017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8ad3c491-e6cb-40e8-9113-1ff4d8bd2bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:16.572610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 531/1067] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:16.873846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:16.874216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:16.874563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:16.876013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 537/1068] 10.222.0.50 () {54 vars in 962 bytes} [Wed Oct 12 12:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:16.881510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4135b5-48da-41cb-82ac-e33a4499f82d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:16.881800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4135b5-48da-41cb-82ac-e33a4499f82d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:16.882078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4135b5-48da-41cb-82ac-e33a4499f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:16.964467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-aa4135b5-48da-41cb-82ac-e33a4499f82d None None] MFA Rules not processed for user `09aecc43a8ab487c8ecfe0673ab12534`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:16.977011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-aa4135b5-48da-41cb-82ac-e33a4499f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:17.049502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:17.056964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 532/1069] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Oct 12 12:34:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:17.066374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:17.068141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:17.183487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b71871-8cfa-4b57-a3cc-f84991e80fb4 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:17.225165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:17.263022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:17.263638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:17.263914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:17.264184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:17.265896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:17.375792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:17.377243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fdd3f2-17ec-49c2-8be3-c7b6f6ee4f16 service glance] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:17.395370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 538/1070] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:18.260180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de794-5e3e-475b-bba1-b4c389efc02e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.260670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de794-5e3e-475b-bba1-b4c389efc02e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.260763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1de794-5e3e-475b-bba1-b4c389efc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.284470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91d3b-938c-44d6-8cd7-5a5c30b1b872 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.284987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91d3b-938c-44d6-8cd7-5a5c30b1b872 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.285069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a91d3b-938c-44d6-8cd7-5a5c30b1b872 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.286444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 539/1071] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:34:18.292129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab2a0-59db-4eba-a174-01f00233a410 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.292413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab2a0-59db-4eba-a174-01f00233a410 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.292688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ab2a0-59db-4eba-a174-01f00233a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.335807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-be1de794-5e3e-475b-bba1-b4c389efc02e None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:18.337029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-be1de794-5e3e-475b-bba1-b4c389efc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.361687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ab8ab2a0-59db-4eba-a174-01f00233a410 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:18.362894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ab8ab2a0-59db-4eba-a174-01f00233a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.381262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:18.426154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 533/1072] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:18.462074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 540/1073] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:34:18.474717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.475011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.475286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.476638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 534/1074] 10.222.0.50 () {54 vars in 943 bytes} [Wed Oct 12 12:34:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:18.482772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.483122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.483431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.578883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] MFA Rules not processed for user `ddc59606d2aa4ce7aa86f25d905b9e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:18.578883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.655753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:18.681930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 541/1075] 10.222.0.50 () {58 vars in 1040 bytes} [Wed Oct 12 12:34:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:34:18.691610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:18.693149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.754258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:18.755498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.779099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:18.834518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5aaa-37f9-414f-96e5-792136e3fddd None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:18.856279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6035646-15d8-4cda-8b10-6703af6a890e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:18.944327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:18.944943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.945272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.945545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.947235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:18.962055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:18.973011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:18.973655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:18.973961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:18.974881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:18.976488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:19.018020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:19.034065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:19.035726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afce025-60f6-49f1-8846-15c0215403bf service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:19.044966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 535/1076] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:34:19.069705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:19.071328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9620f470-e926-4f1b-b0ca-94433a5c7263 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:19.089902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 542/1077] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:34:21.406003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:21.406543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:21.406543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:21.409462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 536/1078] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:21.413934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97852b-62f4-4df4-847f-1fcaccfaae97 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:21.414383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97852b-62f4-4df4-847f-1fcaccfaae97 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:21.414650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97852b-62f4-4df4-847f-1fcaccfaae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:21.489678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4b97852b-62f4-4df4-847f-1fcaccfaae97 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:21.491837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4b97852b-62f4-4df4-847f-1fcaccfaae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:21.565111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:21.607271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 543/1079] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:21.905665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:21.907471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:22.110626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c6f1aa-21af-4c1a-b4f6-655c89b58675 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:22.205967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:22.267754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:22.268663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:22.269106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:22.269656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:22.272074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:22.391658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:22.393347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc244b7-23ee-4128-a0f9-714ff826972b service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:22.412756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 537/1080] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:25.121691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:25.122288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:25.122505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:25.124100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 544/1081] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:25.129367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60947c9-368f-42c4-901e-da73e1ff0569 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:25.129819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60947c9-368f-42c4-901e-da73e1ff0569 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:25.129932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60947c9-368f-42c4-901e-da73e1ff0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:25.202951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d60947c9-368f-42c4-901e-da73e1ff0569 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:25.204165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d60947c9-368f-42c4-901e-da73e1ff0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:25.227037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:25.310259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 538/1082] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:25.600526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:25.602093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:25.768823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b77eb-a3c9-49c6-843c-e38e99232e8a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:25.820740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:25.891432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:25.892022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:25.892313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:25.892585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:25.894298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:26.001918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:26.003604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c879b7-20a7-4979-92d7-46049cd46890 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:26.024913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 545/1083] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:28.390153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:28.390702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:28.390702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:28.392218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 539/1084] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:28.397816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85701-e1b1-4686-8aa0-1180616929a1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:28.398234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85701-e1b1-4686-8aa0-1180616929a1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:28.398419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e85701-e1b1-4686-8aa0-1180616929a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:28.478154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e8e85701-e1b1-4686-8aa0-1180616929a1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:28.479340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e8e85701-e1b1-4686-8aa0-1180616929a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:28.482223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:28.593713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 546/1085] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:34:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:28.885355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:28.886973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:29.059109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daec5f-262a-49ea-8c1b-ec9612345b4e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:29.063400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:29.187583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:29.188613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:29.189111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:29.189763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:29.191664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:29.294802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:29.296518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40930c3f-6343-4c9f-8e66-29ebb56e8fd2 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:29.328404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 540/1086] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:38.591950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=41 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:39.313311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:42.759556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387240-719a-42fb-8fc4-866e65f17373 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:42.760002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387240-719a-42fb-8fc4-866e65f17373 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:42.760096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9387240-719a-42fb-8fc4-866e65f17373 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:42.761489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 547/1087] 10.222.0.50 () {54 vars in 918 bytes} [Wed Oct 12 12:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:42.766655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e8c0-6f97-4e47-8390-1f9da6370c72 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:42.767081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e8c0-6f97-4e47-8390-1f9da6370c72 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:42.767224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e8c0-6f97-4e47-8390-1f9da6370c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:42.843298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-57f0e8c0-6f97-4e47-8390-1f9da6370c72 None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:42.844504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-57f0e8c0-6f97-4e47-8390-1f9da6370c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:42.948568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 541/1088] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Oct 12 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:34:42.962934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845210fe-b07e-41eb-965d-194a17e01ecf None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:42.968090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845210fe-b07e-41eb-965d-194a17e01ecf None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:42.968090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845210fe-b07e-41eb-965d-194a17e01ecf None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:42.968090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 548/1089] 10.222.0.50 () {54 vars in 918 bytes} [Wed Oct 12 12:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:42.969244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337cac-7113-4bac-9e11-db46fda7a077 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:42.969528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337cac-7113-4bac-9e11-db46fda7a077 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:42.969798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b337cac-7113-4bac-9e11-db46fda7a077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:43.044793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:43.048919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7b337cac-7113-4bac-9e11-db46fda7a077 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:43.050167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7b337cac-7113-4bac-9e11-db46fda7a077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:43.164727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 542/1090] 10.222.0.50 () {58 vars in 1015 bytes} [Wed Oct 12 12:34:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:45.730648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:45.731248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:45.731248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:45.732535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 549/1091] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:45.737760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dab40-e9c7-43fc-8eda-f9483c312835 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:45.738182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dab40-e9c7-43fc-8eda-f9483c312835 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:45.738313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6dab40-e9c7-43fc-8eda-f9483c312835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:45.804690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2d6dab40-e9c7-43fc-8eda-f9483c312835 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:45.806436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2d6dab40-e9c7-43fc-8eda-f9483c312835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:45.861223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:45.903130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 543/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:46.192480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:46.194054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:46.341956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5c714-a912-4544-b6e5-7ae5e80fd4b0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:46.415200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:46.454897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:46.455439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:46.455724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:46.456003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:46.457647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:46.546927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:46.548501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd9d146-6a3c-4aae-86f4-77b425f2c54e service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:46.566741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 550/1093] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:47.693179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:47.694107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:47.696677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:47.696677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 544/1094] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:47.701887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f37-571f-4260-b2b2-d55d0062501c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:47.702322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f37-571f-4260-b2b2-d55d0062501c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:47.702441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed880f37-571f-4260-b2b2-d55d0062501c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:47.780029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ed880f37-571f-4260-b2b2-d55d0062501c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:47.781296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ed880f37-571f-4260-b2b2-d55d0062501c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:47.807963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:47.878271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 551/1095] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:48.028537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:48.030176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:48.175938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083bd58-e151-46ea-904c-58248fc37bff None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:48.217493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:48.290021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:48.290557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:48.290838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:48.291108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:48.292703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:48.383649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:48.385278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbabe2-8c2d-4e78-bb76-fbaa2dd49e74 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:48.402997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 545/1096] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:49.528819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:49.529415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:49.529415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:49.530765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 552/1097] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:49.536920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0499-64e8-47c9-8ba5-850049531c0b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:49.537350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0499-64e8-47c9-8ba5-850049531c0b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:49.537552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de0499-64e8-47c9-8ba5-850049531c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:49.591990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:49.614233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-94de0499-64e8-47c9-8ba5-850049531c0b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:49.616018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-94de0499-64e8-47c9-8ba5-850049531c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:49.714060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 546/1098] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:49.864490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:49.866755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:50.009997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb7c13-e46c-404a-857b-f86aba38c823 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:50.022113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:50.122704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:50.123225 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:50.123499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:50.123767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:50.125384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:50.212612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:50.214277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19cc34-af24-4bbd-b606-e87a78cddb89 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:50.232873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 553/1099] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:51.346671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:51.347171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:51.347269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:51.348576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 547/1100] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:51.355552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70d26-90da-4407-b2f2-b5196b9df426 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:51.355988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70d26-90da-4407-b2f2-b5196b9df426 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:51.356170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba70d26-90da-4407-b2f2-b5196b9df426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:51.376571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:51.434143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9ba70d26-90da-4407-b2f2-b5196b9df426 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:51.435366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9ba70d26-90da-4407-b2f2-b5196b9df426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:51.530001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 554/1101] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:51.681136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:51.682725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:51.792608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:51.829668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676288d3-fea7-4e9c-813f-38cea35f809f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:51.943193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:51.943728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:51.944004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:51.944275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:51.945916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:52.023222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:52.036559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:52.038728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bedd9a7-e114-4862-9bb4-1090bfd33a78 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:52.057366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 548/1102] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:53.166715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:53.167205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:53.167332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:53.168655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 555/1103] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:53.175023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee839f27-c629-4a23-831d-8516ede225cf None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:53.175450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee839f27-c629-4a23-831d-8516ede225cf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:53.175573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee839f27-c629-4a23-831d-8516ede225cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:53.252792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ee839f27-c629-4a23-831d-8516ede225cf None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:53.254128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ee839f27-c629-4a23-831d-8516ede225cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:53.351072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 549/1104] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:53.500908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:53.502512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:53.586716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:53.649555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f183e-948b-4631-9596-029da5dc6e85 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:53.761720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:53.762313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:53.762591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:53.762866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:53.764492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:53.812322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:53.866465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:53.866465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ba7fb-5ade-4943-b56e-e63b415acb1b service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:53.878100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 556/1105] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:55.018981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:55.019544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:55.019544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:55.020855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 550/1106] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:55.027722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b5ee-635e-4a45-8b1e-2d9b9f920323 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:55.028164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b5ee-635e-4a45-8b1e-2d9b9f920323 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:55.028265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2b5ee-635e-4a45-8b1e-2d9b9f920323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:55.105170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-adb2b5ee-635e-4a45-8b1e-2d9b9f920323 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:55.106393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-adb2b5ee-635e-4a45-8b1e-2d9b9f920323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:55.200992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 557/1107] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:55.350047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:55.351624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:55.400975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:55.498409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604ee10-97e6-46f9-af15-afacac9e7f8f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:55.609967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:55.610573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:55.610851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:55.611122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:55.612718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:55.620108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:55.702750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:55.704342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219c7e7-ca62-45f8-bfa6-c08dae5e4ed6 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:55.722063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 551/1108] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:56.873538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.874088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.874088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.875435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 558/1109] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:56.882169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c345e0-2127-4fd9-bac8-be9e63da95ab None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:56.882625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c345e0-2127-4fd9-bac8-be9e63da95ab None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:56.882734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c345e0-2127-4fd9-bac8-be9e63da95ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:56.957447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d9c345e0-2127-4fd9-bac8-be9e63da95ab None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:56.958677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d9c345e0-2127-4fd9-bac8-be9e63da95ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:57.026841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:57.055624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 552/1110] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:34:57.207942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:57.209553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:57.227007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:57.355234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d7a18-9e4e-4672-9bfd-0f2da9f9a706 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:57.442380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:57.467758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:57.468371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:57.468650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:57.468925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:57.470568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:57.560253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:57.561879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198237d5-ac7a-4a29-a8bd-23840d4d2c90 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:57.579574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 559/1111] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:34:58.681063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:58.681697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:58.681697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:58.683032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 553/1112] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:34:58.689197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7164-060f-47f8-b75f-14814c38f8d0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:58.689686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7164-060f-47f8-b75f-14814c38f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:58.689812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d7164-060f-47f8-b75f-14814c38f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:58.767736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-546d7164-060f-47f8-b75f-14814c38f8d0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:34:58.768952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-546d7164-060f-47f8-b75f-14814c38f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:58.810938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:58.865314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 560/1113] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:34:59.016810 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:34:59.018292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:59.164554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b703f7-3c83-44d6-bc0a-fc3c3c00dbab None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:34:59.218949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:34:59.278027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:34:59.278567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:34:59.278852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:34:59.279130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:34:59.280736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:34:59.370305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:34:59.371901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdbf705-97bc-4f71-81bb-d11688ad56f0 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:34:59.390426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 554/1114] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:00.481256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.481817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.481817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.483152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 561/1115] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:00.489207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073289-b7e7-4a3d-8dae-7cb1342e66c0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:00.489636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073289-b7e7-4a3d-8dae-7cb1342e66c0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:00.489765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e073289-b7e7-4a3d-8dae-7cb1342e66c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:00.564288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2e073289-b7e7-4a3d-8dae-7cb1342e66c0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:00.565530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2e073289-b7e7-4a3d-8dae-7cb1342e66c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:00.567837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:00.662192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 555/1116] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:35:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:00.812442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:00.814050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:00.957064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae251a-130d-4ee3-84c9-93285c8ef39d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:00.983681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:01.070405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:01.071043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:01.071319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:01.071591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:01.073218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:01.162915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:01.164516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b5637-66fc-4b4c-9fc6-d8b268636774 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:01.182636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 562/1117] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:03.222384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:03.222942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:03.223040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:03.224362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 556/1118] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:03.230321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec601d-1827-4804-b280-3604366b93c3 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:03.230758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec601d-1827-4804-b280-3604366b93c3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:03.230865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec601d-1827-4804-b280-3604366b93c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:03.271275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:03.296400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-12ec601d-1827-4804-b280-3604366b93c3 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:03.297662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-12ec601d-1827-4804-b280-3604366b93c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:03.395083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 563/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:03.679344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:03.680888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:03.784235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20993805-7375-4ad1-b9aa-5a4a96822bb4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:03.816111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:03.859841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:03.860510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:03.860787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:03.861055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:03.863005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:03.973660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:03.975680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2a05e-9e8c-4e27-bd2b-00f42b5c4bda service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:03.994634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 557/1120] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:06.295675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:06.296251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:06.296251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:06.297658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 564/1121] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:06.302928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02945a0-6136-4b97-9a26-8f9f9787ed80 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:06.303369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02945a0-6136-4b97-9a26-8f9f9787ed80 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:06.303474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02945a0-6136-4b97-9a26-8f9f9787ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:06.370337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e02945a0-6136-4b97-9a26-8f9f9787ed80 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:06.371552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e02945a0-6136-4b97-9a26-8f9f9787ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:06.384176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:06.467230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 558/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:06.750325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:06.751887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:06.855044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32688-4ed1-4d26-9f11-a1510325b124 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:06.868221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:06.929024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:06.929658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:06.929938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:06.930210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:06.931812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:07.040629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:07.042094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65286c7a-aaaf-4732-a17c-fad0c78a7d1f service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:07.062223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 565/1123] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:09.632828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:09.633402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:09.633402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:09.634769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 559/1124] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:09.640162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611bd1b-9517-4f0e-8204-1494e51e06b4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:09.640592 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611bd1b-9517-4f0e-8204-1494e51e06b4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:09.640696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611bd1b-9517-4f0e-8204-1494e51e06b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:09.688646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:09.707011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e611bd1b-9517-4f0e-8204-1494e51e06b4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:09.712338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e611bd1b-9517-4f0e-8204-1494e51e06b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:09.803913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 566/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:10.089421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:10.090976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:10.193113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f01b9f-d9ab-47d2-bc97-e33930ab9904 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:10.234788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:10.267655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:10.268250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:10.268524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:10.268790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:10.270402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:10.378935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:10.380361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603a88-b7fd-4e1d-8f0b-97aa490f1e87 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:10.398662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 560/1126] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:12.645015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.645683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.645683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.647702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 567/1127] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:12.652921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9079-f871-4d42-baf7-6203fd9a2b68 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:12.653380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9079-f871-4d42-baf7-6203fd9a2b68 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:12.653489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154b9079-f871-4d42-baf7-6203fd9a2b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:12.719367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-154b9079-f871-4d42-baf7-6203fd9a2b68 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:12.720582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-154b9079-f871-4d42-baf7-6203fd9a2b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:12.741995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:12.818379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 561/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:13.104141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:13.105730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.209119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef0af2-a336-4159-9bf8-4a925b65dcc0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:13.231035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:13.283550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:13.284150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:13.284426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:13.284696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:13.286330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:13.395142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:13.396506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c055ce1-ffa1-4428-bea3-3d6420c19390 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:13.414058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 568/1129] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:15.603014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.603550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.603550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.604916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 562/1130] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:15.610374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11766f-8994-4a95-add9-2c625c5779fd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:15.610815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11766f-8994-4a95-add9-2c625c5779fd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:15.610966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11766f-8994-4a95-add9-2c625c5779fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:15.675004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:15.678421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-dc11766f-8994-4a95-add9-2c625c5779fd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:15.679662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dc11766f-8994-4a95-add9-2c625c5779fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:15.775151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 569/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:16.062543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:16.064091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:16.168267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47010bd-4060-4a6a-b67b-e8ad4e1b63bf None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:16.218478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:16.243004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:16.243605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:16.243888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:16.244162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:16.245799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:16.355704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:16.357175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b506f0-7cf5-40cf-a86d-b47d930f26f8 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:16.375988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 563/1132] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:18.561063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:18.561638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:18.561638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:18.563045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 570/1133] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:18.568667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69dae-0033-4be5-9c5b-d1caee22ac89 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:18.569075 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69dae-0033-4be5-9c5b-d1caee22ac89 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:18.569240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69dae-0033-4be5-9c5b-d1caee22ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:18.633815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e4e69dae-0033-4be5-9c5b-d1caee22ac89 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:18.635009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e4e69dae-0033-4be5-9c5b-d1caee22ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:18.664532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:18.730842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 564/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:19.012742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:19.014341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:19.118239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a365caf-24a8-4ffa-bfaa-c624330f82e4 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:19.147526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:19.192066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:19.192670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:19.192948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:19.193254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:19.195414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:19.303949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:19.305323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b38275-be0e-4c0a-a7f5-e8ee697267e7 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:19.323146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 571/1135] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:21.517581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2c01-8e4c-4658-847c-556227729901 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.518155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2c01-8e4c-4658-847c-556227729901 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.518155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2c01-8e4c-4658-847c-556227729901 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.519467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 565/1136] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:21.526362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e53e-1652-45f9-a89d-c442f0cf094e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:21.526861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e53e-1652-45f9-a89d-c442f0cf094e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:21.526987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874e53e-1652-45f9-a89d-c442f0cf094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:21.594457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4874e53e-1652-45f9-a89d-c442f0cf094e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:21.595709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4874e53e-1652-45f9-a89d-c442f0cf094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:21.604210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:21.692737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 572/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:21.975631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2c01-8e4c-4658-847c-556227729901 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:21.977204 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-656c2c01-8e4c-4658-847c-556227729901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.082210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2c01-8e4c-4658-847c-556227729901 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:22.138234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:22.157308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:22.157903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:22.158178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:22.158440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:22.160014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:22.268585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:22.269941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d05591-a5f8-4849-9876-a9cb368dbf71 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:22.289888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 566/1138] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:24.482552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.483101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.483101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.484474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 573/1139] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:24.489996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a99b0-6776-4818-acd0-9fd64189156a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:24.490429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a99b0-6776-4818-acd0-9fd64189156a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:24.490584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a99b0-6776-4818-acd0-9fd64189156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:24.557986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b03a99b0-6776-4818-acd0-9fd64189156a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:24.559387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b03a99b0-6776-4818-acd0-9fd64189156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:24.641162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:24.658302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 567/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:24.938448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:24.939986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.044806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98272340-be0a-480c-a29e-c4e3131a7de5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:25.083215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:25.119831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:25.120456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:25.120726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:25.121003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:25.122659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:25.230126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:25.231482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a996b7-b032-4807-bb79-9ac3e46aafb9 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:25.251171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 574/1141] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:27.397836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:27.398398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:27.398398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:27.399774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 568/1142] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:27.405218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a166b5-92a6-4e74-a27e-d7fc2707ff73 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:27.405625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a166b5-92a6-4e74-a27e-d7fc2707ff73 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:27.405760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a166b5-92a6-4e74-a27e-d7fc2707ff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:27.472024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e3a166b5-92a6-4e74-a27e-d7fc2707ff73 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:27.473290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e3a166b5-92a6-4e74-a27e-d7fc2707ff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:27.491254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:27.570224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 575/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:27.846925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:27.848553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:27.951859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eb28ef-16a2-4c93-ae3e-57273d30cc37 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:28.022795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:28.029144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:28.029752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:28.030034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:28.030305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:28.031917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:28.143015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:28.144481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e8ed-5848-40c8-84d9-bda29a42f085 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:28.163236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 569/1144] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:30.312452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:30.313024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:30.313024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:30.314441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 576/1145] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:30.320198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05ab4-c780-48ea-913b-acf1d827bd68 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:30.320641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05ab4-c780-48ea-913b-acf1d827bd68 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:30.320743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b05ab4-c780-48ea-913b-acf1d827bd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:30.385768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f3b05ab4-c780-48ea-913b-acf1d827bd68 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:30.386981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f3b05ab4-c780-48ea-913b-acf1d827bd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:30.435282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:30.482581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 570/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:30.762289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:30.763821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:30.867675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab890f-602b-402c-b493-8eeee89f05d8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:30.915123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:30.940278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:30.940886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:30.941194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:30.941471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:30.943329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:31.050702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:31.052060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f71273-8e99-4ab6-b49f-73a8963c4d45 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:31.071808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 577/1147] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:40.489776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=22 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:41.069605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=66 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:50.911831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cbf1-7557-41e9-9a23-9455302542be None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:50.912446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cbf1-7557-41e9-9a23-9455302542be None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:50.912446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e2cbf1-7557-41e9-9a23-9455302542be None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:50.914413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 571/1148] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:35:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:50.919683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb3d5-ee63-41a8-afa9-6a9368564faa None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:50.920094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb3d5-ee63-41a8-afa9-6a9368564faa None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:50.920231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cb3d5-ee63-41a8-afa9-6a9368564faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:50.986469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2c8cb3d5-ee63-41a8-afa9-6a9368564faa None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:50.987685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2c8cb3d5-ee63-41a8-afa9-6a9368564faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:51.083229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 578/1149] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:35:51.378468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:51.378750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:51.379022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:51.380367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 572/1150] 10.222.0.50 () {54 vars in 962 bytes} [Wed Oct 12 12:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:51.385805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c8a18-a2b1-4d37-94af-f471104a629f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:51.386089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c8a18-a2b1-4d37-94af-f471104a629f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:51.386363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c8a18-a2b1-4d37-94af-f471104a629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:51.461790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7c5c8a18-a2b1-4d37-94af-f471104a629f None None] MFA Rules not processed for user `09aecc43a8ab487c8ecfe0673ab12534`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:51.462984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7c5c8a18-a2b1-4d37-94af-f471104a629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:51.483067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:51.540022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 579/1151] 10.222.0.50 () {58 vars in 1059 bytes} [Wed Oct 12 12:35:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:51.547779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:51.549343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:51.655070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4a294-d2e3-4cf2-8932-9c55d0a0cb6a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:51.727665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:51.728262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:51.728539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:51.728811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:51.730526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:51.784885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:51.838991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:51.840424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efb8cc-7305-419b-97e7-18e2824c3e92 service glance] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:51.858429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 573/1152] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:35:54.086279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.086816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.086816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.088220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 580/1153] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:54.093458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d582a-c5da-4870-a342-fcd06e67a048 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.093855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d582a-c5da-4870-a342-fcd06e67a048 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.094021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d582a-c5da-4870-a342-fcd06e67a048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.159039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9e9d582a-c5da-4870-a342-fcd06e67a048 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:54.160251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9e9d582a-c5da-4870-a342-fcd06e67a048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.257172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 574/1154] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:35:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:54.531776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:54.533287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:54.657880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3d679-3d1a-4624-b7bd-25e480935ff5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:54.706332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:54.750008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:54.750608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:54.750883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:54.751152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:54.751779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:54.752875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:35:54.752875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:35:54.752875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:35:54.754031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a29333-409d-41db-b0c0-4576896c2cb0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:54.773098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 581/1155] 10.222.0.50 () {56 vars in 1108 bytes} [Wed Oct 12 12:35:54 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:35:56.917936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:56.918549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:56.918549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:56.919838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 575/1156] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:35:56.925228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e703b-3411-4593-9ee2-e4f1f90f9d53 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:56.925672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e703b-3411-4593-9ee2-e4f1f90f9d53 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:56.925783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e703b-3411-4593-9ee2-e4f1f90f9d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:56.991277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-521e703b-3411-4593-9ee2-e4f1f90f9d53 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:35:56.992492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-521e703b-3411-4593-9ee2-e4f1f90f9d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:57.088530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 582/1157] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:35:57.381080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:35:57.382660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:57.392606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:57.529366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55174ce5-cf9a-4711-9ac9-3f508c682181 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:35:57.608727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:35:57.642286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:35:57.642847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:35:57.643125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:35:57.643394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:35:57.644980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:35:57.735808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:35:57.737434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1a632-48b0-4191-87f0-2585d5e24c31 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:35:57.755947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 576/1158] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:35:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:00.069955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:00.070517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:00.070517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:00.071869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 583/1159] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:36:00.077197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b974-f61a-4d43-8266-864188cde2c8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:00.077648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b974-f61a-4d43-8266-864188cde2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:00.077745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d9b974-f61a-4d43-8266-864188cde2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:00.142803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b4d9b974-f61a-4d43-8266-864188cde2c8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:00.144022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b4d9b974-f61a-4d43-8266-864188cde2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:00.189426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:00.239583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 577/1160] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:36:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:00.533660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:00.535204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:00.560101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:00.641628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b17b8-e240-4a9d-bc5f-a12f54a4ef4f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:00.719484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:00.720091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:00.720367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:00.720635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:00.722273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:00.796234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:00.831228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:00.832663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe50b62-6f71-4995-b765-cf6dc30f341c service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:00.850642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 584/1161] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:03.054126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:03.054647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:03.054647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:03.055961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 578/1162] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:36:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:36:03.061277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8c99-b454-4f8f-b8f4-c6d171b7516c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:03.061709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8c99-b454-4f8f-b8f4-c6d171b7516c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:03.061812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece8c99-b454-4f8f-b8f4-c6d171b7516c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:03.128168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5ece8c99-b454-4f8f-b8f4-c6d171b7516c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:03.129423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5ece8c99-b454-4f8f-b8f4-c6d171b7516c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:03.224743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 585/1163] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:36:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:03.513093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:03.514676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:03.619041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff028604-1ae2-40b9-8ae5-37566a0ab0dc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:03.690825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:03.692545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:03.693228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:03.693510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:03.693782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:03.695551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:03.804363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:03.805832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacea84-fcf6-43fc-a81c-52674fbb8280 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:03.823642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 579/1164] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:06.118263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:06.118822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:06.118822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:06.120197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 586/1165] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:36:06.125611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543a7e-d5a5-48b3-9f93-34ad187b6bec None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:06.126010 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543a7e-d5a5-48b3-9f93-34ad187b6bec None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:06.126168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79543a7e-d5a5-48b3-9f93-34ad187b6bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:06.191765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-79543a7e-d5a5-48b3-9f93-34ad187b6bec None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:06.193254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-79543a7e-d5a5-48b3-9f93-34ad187b6bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:06.245619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:06.289071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 580/1166] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:36:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:06.581536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:06.583079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:06.620080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:06.687411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500252cb-949c-4a58-a4d1-4ef2bd3870c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:06.760420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:06.761027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:06.761336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:06.761618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:06.763230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:06.844894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:06.873714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:06.875175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11efea-c150-44d6-b3ad-8c0a1eaf83ef service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:06.893348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 587/1167] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:09.427215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:09.427776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:09.427776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:09.429152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 581/1168] 10.222.0.50 () {54 vars in 927 bytes} [Wed Oct 12 12:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:36:09.434325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ce02-9acc-4027-9300-ebb0064f08c4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:09.434771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ce02-9acc-4027-9300-ebb0064f08c4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:09.434868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450ce02-9acc-4027-9300-ebb0064f08c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:09.500653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6450ce02-9acc-4027-9300-ebb0064f08c4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:36:09.501896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6450ce02-9acc-4027-9300-ebb0064f08c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:09.597743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 588/1169] 10.222.0.50 () {58 vars in 1024 bytes} [Wed Oct 12 12:36:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:36:09.885574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:36:09.887114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:09.990006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0315ff3e-8c36-40d0-864b-5658891889a7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:36:10.063588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:36:10.064187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:36:10.064463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:36:10.064731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:36:10.066337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:36:10.075699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:10.176845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:36:10.178233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550425dc-853d-44a1-a75f-5e030cee3b6c service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:36:10.196805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 582/1170] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:36:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:36:19.596215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=82 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:20.194127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=50 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:31.551781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:31.552327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:31.552327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:31.627556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:31.628756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:31.725790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 589/1171] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:31.734051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:31.734576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:31.734677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:31.809026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:31.810181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:31.905032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 583/1172] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:31.909613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:31.910812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:31.922379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5351f2-f44e-4593-866e-6ecc5163824f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:31.984428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:32.018189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.018801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.019076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.019346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:32.019986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:37:32.020288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:32.021337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:37:32.021337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:37:32.021337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:37:32.022222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:32.034084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 590/1173] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:37:32.043526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:32.052664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89ba0d-7d64-40f7-aab8-e30e6869317f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:32.113762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:32.147296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.147899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.148176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.148446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:32.149078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:32.150201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:37:32.150201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:37:32.150201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:37:32.151380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:32.289843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 584/1174] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:37:32 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:37:32.294058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:32.295615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:32.330672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21f628-d684-4a53-8c06-82897f6d9192 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:32.423908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.424438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.424716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.424989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:32.425649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:32.426659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:37:32.426659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:37:32.426659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:37:32.427865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:32.535496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 591/1175] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:37:32 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:37:32.539619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:32.541798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:32.606560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01be458-ece6-4ccf-bd3a-9d506bf73113 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:32.690890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:32.701065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.705099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.705099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.705099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:32.705099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:32.705099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:32.716976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 585/1176] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:37:32.720933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:32.722619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:32.734491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ef80f3-e4f5-4295-ad6c-8d5d89d7975d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:32.759972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:32.829073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.829711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.829993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.830266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:32.830959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:32.834058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489349d5-4244-4224-8c26-f6aeae421c13 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:32.847613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 592/1177] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:37:32.851724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:32.853291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:32.886613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765598b8-c4cc-4a80-90fc-5f84e59de1bb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:32.979831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:32.980417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:32.980694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:32.980964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] PATH_INFO: `/v3/projects/e7c0a104edc04115a4e01ee5b4d9d6af/users/38e453cfc3ff415898d7bdac644e9ec1/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.002976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7c0a104edc04115a4e01ee5b4d9d6af, user_id=38e453cfc3ff415898d7bdac644e9ec1, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:33.005656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d7a54-9ea4-4f84-a6a0-3d147973f879 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:33.073449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 586/1178] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:37:32 2022] PUT /identity/v3/projects/e7c0a104edc04115a4e01ee5b4d9d6af/users/38e453cfc3ff415898d7bdac644e9ec1/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:37:33.084600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfe5d-3625-4027-8466-de5f2762e127 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.084890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfe5d-3625-4027-8466-de5f2762e127 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.085188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401dfe5d-3625-4027-8466-de5f2762e127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.142578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-401dfe5d-3625-4027-8466-de5f2762e127 None None] MFA Rules not processed for user `38e453cfc3ff415898d7bdac644e9ec1`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:33.143795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-401dfe5d-3625-4027-8466-de5f2762e127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:33.222572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 593/1179] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:33.235766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.235999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.236280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.237717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 587/1180] 10.222.0.50 () {54 vars in 963 bytes} [Wed Oct 12 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:37:33.242368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb867-3c7f-40f4-bc68-4bd87effad03 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.242862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb867-3c7f-40f4-bc68-4bd87effad03 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.243041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8bb867-3c7f-40f4-bc68-4bd87effad03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.274479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:33.318375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3d8bb867-3c7f-40f4-bc68-4bd87effad03 None None] MFA Rules not processed for user `4a804dd78ed44695afad6616ac504d03`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:33.319864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3d8bb867-3c7f-40f4-bc68-4bd87effad03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:33.395980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 594/1181] 10.222.0.50 () {58 vars in 1060 bytes} [Wed Oct 12 12:37:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:33.404240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:33.405797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:33.456535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:33.509963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb5ab5-436a-41be-a085-5608376f38df None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:33.583770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:33.584370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.584646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.584915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.586530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:33.686431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:33.687882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:33.691416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:33.706269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 588/1182] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:37:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:37:33.752630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155942-e1d0-48e7-9561-241eeefcc1de None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.753048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155942-e1d0-48e7-9561-241eeefcc1de None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.753215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1155942-e1d0-48e7-9561-241eeefcc1de None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.754495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 595/1183] 10.222.0.50 () {52 vars in 830 bytes} [Wed Oct 12 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:37:33.758036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:33.759446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:33.859265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bf529-bcae-4d0b-a36f-a80fc7929a8c service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:33.950251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:33.950866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:33.951145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:33.951412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] PATH_INFO: `/v3/users/38e453cfc3ff415898d7bdac644e9ec1` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:33.963962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e453cfc3ff415898d7bdac644e9ec1)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:33.965015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:37:33.965015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:37:33.965015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:37:33.966400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:33.977688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:34.191764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e453cfc3ff415898d7bdac644e9ec1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:34.205429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e453cfc3ff415898d7bdac644e9ec1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:34.227829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e453cfc3ff415898d7bdac644e9ec1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:34.228283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e453cfc3ff415898d7bdac644e9ec1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:34.301760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e453cfc3ff415898d7bdac644e9ec1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:34.308419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 589/1184] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:37:33 2022] DELETE /identity/v3/users/38e453cfc3ff415898d7bdac644e9ec1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:37:34.312838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:34.313151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:34.313430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:34.372203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:37:34.373507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:34.449920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:34.462140 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 596/1185] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:37:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:37:34.477038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:34.477038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:34.575176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc2185-de36-4b92-83cd-4a2ea6034c38 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:34.628729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:34.647357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:34.647967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:34.648239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:34.648502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:34.650131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:34.758527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:34.759888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0004d-7031-499e-abc2-f06f582986e5 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:34.780557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 590/1186] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:37:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:37:35.241736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:37:35.242986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:37:35.255115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412f9a3-bae1-4f93-be53-02a301e8bd56 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:37:35.354038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:37:35.354680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:37:35.354960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:37:35.355235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] PATH_INFO: `/v3/projects/e7c0a104edc04115a4e01ee5b4d9d6af` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:37:35.366763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7c0a104edc04115a4e01ee5b4d9d6af)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:37:35.367792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:37:35.367792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:37:35.367792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:37:35.368984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:37:35.511198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7c0a104edc04115a4e01ee5b4d9d6af', 'request_id': 'req-de9b6665-bf86-471c-8c84-445a516c0344'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:35.517263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7c0a104edc04115a4e01ee5b4d9d6af', 'request_id': 'req-de9b6665-bf86-471c-8c84-445a516c0344'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:35.530935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7c0a104edc04115a4e01ee5b4d9d6af', 'request_id': 'req-de9b6665-bf86-471c-8c84-445a516c0344'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:35.625521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] The token cache is being invalidate because project e7c0a104edc04115a4e01ee5b4d9d6af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:37:35.625810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:35.626237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-de9b6665-bf86-471c-8c84-445a516c0344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:37:35.627644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 597/1187] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:37:35 2022] DELETE /identity/v3/projects/e7c0a104edc04115a4e01ee5b4d9d6af => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:37:44.776989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=62 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:45.623370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:06.417964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:06.418559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:06.418559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:06.419886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 591/1188] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:06.425064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845341b-7384-4964-8926-03cba131ff90 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:06.425541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845341b-7384-4964-8926-03cba131ff90 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:06.425691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845341b-7384-4964-8926-03cba131ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:06.506652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a845341b-7384-4964-8926-03cba131ff90 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:06.507880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a845341b-7384-4964-8926-03cba131ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:06.610210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 598/1189] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:06.766659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:06.769539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:06.887218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b281c-c41a-4e1c-a2c0-2cd709f6d60e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:06.892739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:06.893369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:06.893647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:06.893918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:06.901890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:06.903467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c994e-8d9c-4e93-aae8-ac440539f8b0 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:06.912671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 592/1190] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:07.989230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6738-d05e-4a83-93a8-d64c2dbb6888 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:07.989756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6738-d05e-4a83-93a8-d64c2dbb6888 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:07.989756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6738-d05e-4a83-93a8-d64c2dbb6888 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:07.991092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 599/1191] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:07.997208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095e8a-70c3-4993-bebb-b3452000d21c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:07.997651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095e8a-70c3-4993-bebb-b3452000d21c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:07.997758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7095e8a-70c3-4993-bebb-b3452000d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:08.018397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d7095e8a-70c3-4993-bebb-b3452000d21c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:08.019607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d7095e8a-70c3-4993-bebb-b3452000d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:08.027480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 593/1192] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:08.181487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6738-d05e-4a83-93a8-d64c2dbb6888 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:08.196658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6738-d05e-4a83-93a8-d64c2dbb6888 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:08.202101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:08.202690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:08.202969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:08.203239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:08.212257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:08.213961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824db25-8390-4110-9934-444556e7b9a9 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:08.223472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 600/1193] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:08.617034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d55e-52a5-41f5-933a-390e8504f930 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:08.621580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d55e-52a5-41f5-933a-390e8504f930 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:08.621580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97d55e-52a5-41f5-933a-390e8504f930 None None] PATH_INFO: `/v3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:08.621580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 594/1194] 10.222.0.46 () {54 vars in 925 bytes} [Wed Oct 12 12:39:08 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:39:08.626663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca223-4675-4198-a12d-95a2057628ca None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:08.626957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca223-4675-4198-a12d-95a2057628ca None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:08.627824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ca223-4675-4198-a12d-95a2057628ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:08.686951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1f6ca223-4675-4198-a12d-95a2057628ca None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:08.688184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1f6ca223-4675-4198-a12d-95a2057628ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:08.705152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:08.763863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 601/1195] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 12 12:39:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:12.522576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34e51-fb3f-4725-a5e9-2a358f0c6dd9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:12.523098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34e51-fb3f-4725-a5e9-2a358f0c6dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:12.523098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd34e51-fb3f-4725-a5e9-2a358f0c6dd9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:12.524454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 595/1196] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:12.529683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff2c1-3acb-48ba-b794-788517753304 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:12.530103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff2c1-3acb-48ba-b794-788517753304 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:12.530237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ff2c1-3acb-48ba-b794-788517753304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:12.551224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-327ff2c1-3acb-48ba-b794-788517753304 None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:12.552472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-327ff2c1-3acb-48ba-b794-788517753304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:12.560957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 602/1197] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:12.568680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34e51-fb3f-4725-a5e9-2a358f0c6dd9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:12.582351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd34e51-fb3f-4725-a5e9-2a358f0c6dd9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:12.587185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:12.587769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:12.588082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:12.588355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:12.596901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:12.598508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a9831-cda4-442f-8aef-105cf862af35 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:12.607888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 596/1198] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:19.694567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700274-84a8-4820-88df-10de2d387930 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:19.695176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700274-84a8-4820-88df-10de2d387930 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:19.695176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9700274-84a8-4820-88df-10de2d387930 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:19.696723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 603/1199] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:19.702866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf6c-1cc4-4bea-b179-dcbcb932be67 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:19.703314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf6c-1cc4-4bea-b179-dcbcb932be67 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:19.703423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aecf6c-1cc4-4bea-b179-dcbcb932be67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:19.723663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b0aecf6c-1cc4-4bea-b179-dcbcb932be67 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:19.724869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b0aecf6c-1cc4-4bea-b179-dcbcb932be67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:19.732585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 597/1200] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:19.884775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9700274-84a8-4820-88df-10de2d387930 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:19.899321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9700274-84a8-4820-88df-10de2d387930 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:19.904807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:19.905428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:19.905707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:19.905975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:19.914497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:19.916051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80dc3-0319-4113-ae9f-f0321d9c10ff service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:19.925314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 604/1201] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:39:20.990866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121525d-077c-4c57-9446-62de6c6dfe5d None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:20.991388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121525d-077c-4c57-9446-62de6c6dfe5d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:20.991388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121525d-077c-4c57-9446-62de6c6dfe5d None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:20.992766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 598/1202] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 12 12:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:20.998782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139277f-af9e-4a5e-ad51-c01842d761ff None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:20.999222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139277f-af9e-4a5e-ad51-c01842d761ff None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:20.999489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139277f-af9e-4a5e-ad51-c01842d761ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:21.019338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7139277f-af9e-4a5e-ad51-c01842d761ff None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:21.020549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7139277f-af9e-4a5e-ad51-c01842d761ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:21.028444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 605/1203] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 12 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:21.178485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121525d-077c-4c57-9446-62de6c6dfe5d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:21.192435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121525d-077c-4c57-9446-62de6c6dfe5d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:21.198070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:21.198652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:21.198931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:21.199204 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:21.207617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:21.209223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c9dc8-e1a9-4ecd-9060-8f52a295ec27 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:21.218428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 599/1204] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:25.444615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:25.445162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:25.445256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:25.446857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 606/1205] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:39:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:25.452176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57246-99fe-4d67-a2d9-0e44b92f2735 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:25.452578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57246-99fe-4d67-a2d9-0e44b92f2735 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:25.452725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce57246-99fe-4d67-a2d9-0e44b92f2735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:25.472318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5ce57246-99fe-4d67-a2d9-0e44b92f2735 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:25.473532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5ce57246-99fe-4d67-a2d9-0e44b92f2735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:25.481487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 600/1206] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:39:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:25.769248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:25.770929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:25.849512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed8ee1-467d-4133-9f6b-6133dd3473d8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:25.853060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:25.853684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:25.853962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:25.854233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:25.862953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:25.864395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c757ad81-89e7-48e4-9936-f63fbda26009 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:25.873606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 607/1207] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:28.009650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce060f-15bb-4f73-b807-bcfd146d5918 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:28.010213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce060f-15bb-4f73-b807-bcfd146d5918 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:28.010375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ce060f-15bb-4f73-b807-bcfd146d5918 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:28.011739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 601/1208] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:28.017045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf02e-8f5a-4299-b21f-88ef26bf28cd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:28.017495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf02e-8f5a-4299-b21f-88ef26bf28cd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:28.017646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaf02e-8f5a-4299-b21f-88ef26bf28cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:28.037036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8baaf02e-8f5a-4299-b21f-88ef26bf28cd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:28.038303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8baaf02e-8f5a-4299-b21f-88ef26bf28cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:28.046314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 608/1209] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:28.332944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce060f-15bb-4f73-b807-bcfd146d5918 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:28.343592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ce060f-15bb-4f73-b807-bcfd146d5918 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:28.347612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:28.348195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:28.348471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:28.348741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:28.358975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:28.360398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4606f-2168-4c69-85fe-18c549224440 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:28.370547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 602/1210] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:31.936810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:31.937378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:31.937378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:31.938747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 609/1211] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:31.944464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19535-8493-4edf-aa42-7bce14d52672 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:31.944868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19535-8493-4edf-aa42-7bce14d52672 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:31.945019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a19535-8493-4edf-aa42-7bce14d52672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:31.965109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-80a19535-8493-4edf-aa42-7bce14d52672 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:31.966344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-80a19535-8493-4edf-aa42-7bce14d52672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:31.974410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 603/1212] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:32.280581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:32.282373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:32.349044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:32.362539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bd5791-afa9-4e97-835a-e2bb79210cad None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:32.366180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:32.366785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:32.367068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:32.367346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:32.376328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:32.378525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a300ea5-1461-46fd-8878-e43041d6a9ff service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:32.388697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 610/1213] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:34.522285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:34.522811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:34.522945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:34.524197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 604/1214] 127.0.0.1 () {54 vars in 917 bytes} [Wed Oct 12 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:39:34.529550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ca70-9742-4ce3-8fe5-0b50d861b692 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:34.529925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ca70-9742-4ce3-8fe5-0b50d861b692 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:34.530108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74ca70-9742-4ce3-8fe5-0b50d861b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:34.550231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7c74ca70-9742-4ce3-8fe5-0b50d861b692 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:39:34.551442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7c74ca70-9742-4ce3-8fe5-0b50d861b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:34.559335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 611/1215] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Oct 12 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:39:34.862930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:39:34.864626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:39:34.872290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:34.878138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53e32b-415f-4c09-8b1e-299a768e88cd None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:39:34.881824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d282c-9868-452f-93d9-79091743311c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:39:34.882417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d282c-9868-452f-93d9-79091743311c service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:39:34.890758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d282c-9868-452f-93d9-79091743311c service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:39:34.890758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d282c-9868-452f-93d9-79091743311c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:39:34.891841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d282c-9868-452f-93d9-79091743311c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:39:34.893873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d282c-9868-452f-93d9-79091743311c service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:39:34.903497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 605/1216] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:39:44.545353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=11 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:44.911551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:00.891307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:00.892503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:00.893103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:00.918998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:00.920270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:00.937190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 612/1217] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:00.948114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:00.948937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:00.950431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:00.983435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:00.984669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:00.999448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 606/1218] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.004001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.017413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9cface-200d-46f2-9d28-f4a366f929d8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.025516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.026134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.026417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.026696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.027349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.027658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.033337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed977bd-aadc-40dc-b311-75906bfc6300 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.046181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 613/1219] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.055106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.069763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf1e22-80da-47f3-8cf0-c6fcdd0e56c1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.077456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.079299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.079584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.079854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.080494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.082537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32081c13-4350-43ec-b491-b33544ebcd19 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.119693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5195085-a19d-4a44-8580-d9d6191d28ee None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.120046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5195085-a19d-4a44-8580-d9d6191d28ee None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.120265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5195085-a19d-4a44-8580-d9d6191d28ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.151181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f5195085-a19d-4a44-8580-d9d6191d28ee None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.152337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f5195085-a19d-4a44-8580-d9d6191d28ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.169015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 614/1220] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:01.170474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6718-5048-4447-ab4f-277ee881d1fb None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.170762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6718-5048-4447-ab4f-277ee881d1fb None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.171044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a6718-5048-4447-ab4f-277ee881d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.201761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-586a6718-5048-4447-ab4f-277ee881d1fb None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.203169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-586a6718-5048-4447-ab4f-277ee881d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.218636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 615/1221] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.220070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.222983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.222983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.231510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 607/1222] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:01.233486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d40f-a578-4ddb-a632-578aad16b799 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.234625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d40f-a578-4ddb-a632-578aad16b799 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.234978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d40f-a578-4ddb-a632-578aad16b799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.262194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.263567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.280548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a5b0d40f-a578-4ddb-a632-578aad16b799 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.282552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a5b0d40f-a578-4ddb-a632-578aad16b799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.366358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 616/1223] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.367544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.375203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 608/1224] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.376741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0fc4c-fd99-478c-9fae-bad7d3473570 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.377031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0fc4c-fd99-478c-9fae-bad7d3473570 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.377283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35005b8-0085-40ad-9635-6301a30e9660 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.377412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0fc4c-fd99-478c-9fae-bad7d3473570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.382557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.383432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.383716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.383993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.384619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.386567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa642e3-30a1-4804-a727-ebbf56785890 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.399839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2ef0fc4c-fd99-478c-9fae-bad7d3473570 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.401054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2ef0fc4c-fd99-478c-9fae-bad7d3473570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.412042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 609/1225] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.412042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51002868-2222-46f2-8a20-0cb167cb81dc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.412042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51002868-2222-46f2-8a20-0cb167cb81dc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.412042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51002868-2222-46f2-8a20-0cb167cb81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.430781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-51002868-2222-46f2-8a20-0cb167cb81dc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.431972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-51002868-2222-46f2-8a20-0cb167cb81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.439817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 610/1226] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.440962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.441293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.441571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.461353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.469270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 617/1227] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:01.469398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.469495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.469495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.469495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.472413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 611/1228] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.473284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.483738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.484957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.486945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbee9f-0f5f-4c9e-b5a5-0b33604b7313 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.491804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.492501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.492764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.492955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.493479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 618/1229] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.493659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.493963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.494326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.494982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:41:01.494982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:41:01.494982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:41:01.495883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de107cf-6e7d-4f2e-8aad-e037cc29f46a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.504079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4aca56-b321-47e8-b8a6-2c5495283d7a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.508991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.509234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 612/1230] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.509643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.509989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.510271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.510467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d74-0493-4725-8b6f-f930ae440abc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.510763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d74-0493-4725-8b6f-f930ae440abc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.510927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.511044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98779d74-0493-4725-8b6f-f930ae440abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.511237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.512891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1005b1c-d98a-43b6-bc60-f1b40383f5df admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.526570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 619/1231] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.527346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.527646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.527918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.533982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-98779d74-0493-4725-8b6f-f930ae440abc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.535199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98779d74-0493-4725-8b6f-f930ae440abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.543887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 613/1232] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.545369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20395-e2ae-4554-a1de-7b658cea207a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.545369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20395-e2ae-4554-a1de-7b658cea207a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.545736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b20395-e2ae-4554-a1de-7b658cea207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.548755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.550000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.558477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 620/1233] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.559280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.566518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f6b20395-e2ae-4554-a1de-7b658cea207a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.567740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f6b20395-e2ae-4554-a1de-7b658cea207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.571323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eb1916-f805-4442-965e-56da8d295e47 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.576140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 614/1234] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.576293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.576752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.577030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.577338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.577465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.577697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.577976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.578106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.579735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9582f-b1e3-47b5-8191-a166f7f14ae0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.593492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 621/1235] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:01.593492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.593492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.593492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.598301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.601645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.608123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 615/1236] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.609029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.613249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.614588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.618776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f968ddc7-ef8a-4a79-960f-1156aa814eec None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.622548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 622/1237] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.623308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.623584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.624188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.624592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.624802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.625471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.630475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faebc1f-201a-4eee-9886-df0bf26ef050 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.636034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e449bb-bca4-49e7-b53f-12197ba998b8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.640733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.641364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.641686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.641967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.642790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.644281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:41:01.644281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:41:01.644281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:41:01.645661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.736456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 616/1238] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:01.737886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.738187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.738521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.757417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:01.758634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:01.762585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 623/1239] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:01.762585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.809823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:01.810049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:01.825232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 617/1240] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:01.826073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.826198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d377b-307d-476f-a417-f659f19cc6c4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.831384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.832002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.832293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.832555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.833241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.833548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.835667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.836371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9274202-f50b-434c-b543-015ea0255fdf None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.841083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.841710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.841996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.842365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.843093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.843406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.845019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.847352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 624/1241] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.849207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.858011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 618/1242] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.858843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.860746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7223b2-4eaf-4934-bea5-2ff96a7d9119 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.865461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.866917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.866917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.866917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.867295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.868894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.874001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e722c-30d2-4dc6-b55a-e6e131cfd99e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.879373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 625/1243] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:01.879630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.880178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.880300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.880543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.880758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.882011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.882329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.884255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.891809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efacdd47-9b52-4087-924e-fb536beb4c38 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.902338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 619/1244] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.902484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.902609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.902702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.911596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d943df8-1de4-47c9-bfa2-ccede3573a0f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.920798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 626/1245] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:01.920798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:01.921175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.921175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.921175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.921175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.921565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.921565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:41:01.921565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:41:01.921565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:41:01.921565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:01.924478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4527b1e-6d1f-4af5-a8d4-96cbc8a62f81 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:01.929207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:01.929797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:01.930077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:01.930358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:01.930990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:01.932909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.027426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 620/1246] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.028286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.041102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 627/1247] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:01 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.041322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36008ab8-20f7-43b6-8c94-1c3436b96de7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.041425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.045620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.046225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.046507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.046785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.047441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:02.047747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.049233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4884db5-810a-44b4-af5f-df169898140d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.049427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.054346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.054949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.055232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.055511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.056147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.058585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.062020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 621/1248] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:02.062821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.073067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c7814-cd12-4747-b369-4459cbc922ad admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.077980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.078572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.078852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.079129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.079780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.081703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.142214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 628/1249] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.143104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.203297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb52ae3-1921-474c-8b90-3153a660bfab admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.207880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.208539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.208818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.209094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] PATH_INFO: `/v3/projects/4a74d9f284c743b29408608233030036/users/dd934777e6134421ab06aabb266ee4c0/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.220893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 622/1250] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.220893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.225337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a74d9f284c743b29408608233030036, user_id=dd934777e6134421ab06aabb266ee4c0, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.227366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.283020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8eb955-af37-473c-aea8-c839d44140e1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.287686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.292329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.292329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.292329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.292329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.292329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.317576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 629/1251] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:02 2022] PUT /identity/v3/projects/4a74d9f284c743b29408608233030036/users/dd934777e6134421ab06aabb266ee4c0/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:02.318407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.375560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:02.379156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97015a42-d9de-4df4-b667-62fc011f9603 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.384411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.385036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.385359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.385637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.386264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.388204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.404608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 623/1252] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 393 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.407304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.462807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:02.467442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684798d9-eb71-4369-87ce-3b9df9d8e941 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.472317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.472919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.473234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.473513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.474159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.475789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.485495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 624/1253] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:02.486429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.496686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43370ae9-9ce7-4642-ad2a-50fc6b949813 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.496889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 630/1254] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 385 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.497814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.555463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.556154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.556569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.556939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.557702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.559396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.561711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d4b61-fa6b-4d48-b1c2-1391729acf80 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.566611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.567216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.567511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.567811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.568440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.570627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 625/1255] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:02.571006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.572276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.582380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306163d-e391-4fdd-875b-44cde115fe49 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.587156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.587742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.588027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.588298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.588919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.590849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37ac42-6539-49fe-b41c-3b8b9d2f8861 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.684026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 631/1256] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 373 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.684963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.694848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 626/1257] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.696096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.696381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.696697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.724185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] MFA Rules not processed for user `dd934777e6134421ab06aabb266ee4c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:02.726009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:02.750300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5043baf0-7271-4348-b8dc-dfaa51145ec2 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.754953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.755562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.755844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.756118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.756751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.758745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.790437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 627/1258] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:02.791351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.801789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577c138-9dac-4e1d-a2a7-d06492d32664 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.807046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.807567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.807852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.808131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.808750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.810705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.831350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 632/1259] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.831779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.841391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd407ae-b862-496c-bdc3-9f0ca2f9af3a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.846028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.846611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.846893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.847170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.847803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.849449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.859740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 633/1260] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:02.863284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.870328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e0cfc-6bb2-4d6d-afe2-9b148d7b437d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.874905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.875453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.875736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.876011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.876658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.878526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.886949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 628/1261] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.886949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.894752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e15334-da76-4490-887c-24a7466559a0 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.899665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.900246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.900529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.900803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.901499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.903097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.914106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 629/1262] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:02.914993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.924296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2bce-f665-43b1-ba57-24a7815e5de6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.930782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.930782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.930782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.930782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.931292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.933115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.956936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 634/1263] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:02.960044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.967625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c4aa1-a880-4873-9e52-4018e23c0934 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:02.972282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:02.972851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:02.973159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:02.973430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:02.974059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:02.976269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:02.986569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 635/1264] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:02.988240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:02.996905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922211-5a40-4938-b68e-b1638e93a339 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.001564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.002149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.002452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.002724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.003377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.005259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.014755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 630/1265] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:03.014755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.024321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.024718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1fab54-5a39-4a47-af8a-498107cc3e0e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.029448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.030025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.030317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.030566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.031196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.032779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.043187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 631/1266] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.045607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.048543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.053606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980bc8d-8c64-42b6-84e5-44c88ef20bce admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.058129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.058676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.058961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.059233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] PATH_INFO: `/v3/projects/426500481e9a4eb8bfb893023988a0c9/users/a50d4e2b72a045b0bf1e9afad975e1fa/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.073196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=426500481e9a4eb8bfb893023988a0c9, user_id=a50d4e2b72a045b0bf1e9afad975e1fa, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.076054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.113501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 636/1267] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:02 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:03.114533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.158180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 632/1268] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/426500481e9a4eb8bfb893023988a0c9/users/a50d4e2b72a045b0bf1e9afad975e1fa/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:03.159011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.177526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6afec48-48a5-47b2-aa4a-4119e6111894 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.222483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca871bc3-99a9-4df9-9046-af07309802cc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.227888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.228548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.228824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.229098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] PATH_INFO: `/v3/projects/f74766b389da45b982bdf8c641ec7a8e/users/29bf13dace764361a2dc8f4d1a3281c1/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.236115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.236745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.237022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.237344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.238003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.239767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.246172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f74766b389da45b982bdf8c641ec7a8e, user_id=29bf13dace764361a2dc8f4d1a3281c1, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.248880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.249864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 637/1269] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.250668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.260198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b2565-9efa-43e9-a7c3-b37512585376 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.264729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.265344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.265625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.265902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.266532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.268088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.278103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 638/1270] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.279007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.288763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611594ac-9863-477f-936a-c48bf8b9d893 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.293542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.294112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.294390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.294667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.295283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.296868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.306899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 639/1271] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.307657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.322702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 633/1272] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/f74766b389da45b982bdf8c641ec7a8e/users/29bf13dace764361a2dc8f4d1a3281c1/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:03.322702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.322970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef029469-5158-4091-aa58-712ea3817afb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.382566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.383222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.383505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.383785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.384424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.385103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657af90-e367-4ebb-bda8-625633f724fa admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.386046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.390919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.391535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.391820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.392095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.392736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.394369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845c7389-220b-4db5-8d22-c20b8eb9fc24 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.395794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 640/1273] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.396655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.405522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 634/1274] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.406969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab1c0-ea3e-42cc-9557-f3e5cbd78a6e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.407120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.407291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.407532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.412587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.413211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.413513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.413770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.414394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.416297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9167b-5cb3-46c1-a8b4-f6cae0fa34cc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.426410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:03.427369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.427652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:03.435521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 635/1275] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:03.436295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.446215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1911d-dfbb-4cd9-b032-0281f8b78a3b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.451085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.451677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.451961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.452232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.452869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.454523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.468673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 636/1276] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.468673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.475415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99a63d4-d92c-47b9-a609-fb8da613a60b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.480224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.480803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.481084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.481387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.482012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.483573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.496181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 637/1277] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.496181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.503267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4902c8b-8079-4df4-8f1a-fd0f89ace8b0 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.508303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.508896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.509210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.509481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] PATH_INFO: `/v3/projects/2e169b5ab8424947a018938ded2b67bf/users/bbb66502c4d64e4f8b01f3e0b2b7bf42/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.524682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e169b5ab8424947a018938ded2b67bf, user_id=bbb66502c4d64e4f8b01f3e0b2b7bf42, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.527423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.544834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 641/1278] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:03 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:03.546267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.546565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.546831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.574609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] MFA Rules not processed for user `29bf13dace764361a2dc8f4d1a3281c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:03.575748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:03.609412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 638/1279] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/2e169b5ab8424947a018938ded2b67bf/users/bbb66502c4d64e4f8b01f3e0b2b7bf42/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:03.610269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.620499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.651607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 642/1280] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:03.652446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.670858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba91632-279e-4c15-80b1-c8805a52c3fe None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.680936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1adee63-8cbb-457b-8217-ec2c908ff4ff admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.686064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.689484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.689484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.689484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.689484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.689860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.702733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 639/1281] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:03.703577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.734771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.735458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.735797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.736078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] PATH_INFO: `/v3/projects/a7ef55ce29924999b14a49b428ec8c70/users/4eac367fb11f47c8b78ef739a63cc4d9/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.751266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ef55ce29924999b14a49b428ec8c70, user_id=4eac367fb11f47c8b78ef739a63cc4d9, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.754022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.758456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb6a35-7fcd-4a5d-98a3-f05dffe2937b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.762253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.762892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.765610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.765610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.772442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.773932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.783585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 640/1282] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:03.784569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.793930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439c1c4-9c63-4e67-ad90-369fcd74700b service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.798668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.799302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.799587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.799868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] PATH_INFO: `/v3/projects/b48b7431153449c2bce1a7491b573e80/users/1ac2e3720a324751bacef35327cc089a/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.815216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48b7431153449c2bce1a7491b573e80, user_id=1ac2e3720a324751bacef35327cc089a, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.818038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.831096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 643/1283] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/a7ef55ce29924999b14a49b428ec8c70/users/4eac367fb11f47c8b78ef739a63cc4d9/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:03.832289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.894017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8ed1c-22ae-4cf9-bf85-6b16f83f9c50 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.899106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.899620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.899906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.900186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] PATH_INFO: `/v3/projects/61e5cce6874049ffbc45488597c6be30/users/56392b5a93bb44c2a859f3751902772e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.912284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:03.916731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e5cce6874049ffbc45488597c6be30, user_id=56392b5a93bb44c2a859f3751902772e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.918607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 641/1284] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/b48b7431153449c2bce1a7491b573e80/users/1ac2e3720a324751bacef35327cc089a/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:03.919466 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d0db9-71b5-4f84-828d-a2e59baf8dbe admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:03.919588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:03.982000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b10d1-8055-48c6-964a-603c0a24963d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:03.986665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:03.987282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:03.989370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:03.989370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:03.989370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:03.990091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d098b494-dcd3-4f62-86c3-f81f097d1e91 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.000522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 642/1285] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:04.001778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bdf5e-30c6-4c7d-8b05-186f7d4eb4bf None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.002096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bdf5e-30c6-4c7d-8b05-186f7d4eb4bf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.002376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bdf5e-30c6-4c7d-8b05-186f7d4eb4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.029577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-871bdf5e-30c6-4c7d-8b05-186f7d4eb4bf None None] MFA Rules not processed for user `bbb66502c4d64e4f8b01f3e0b2b7bf42`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.030787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-871bdf5e-30c6-4c7d-8b05-186f7d4eb4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.043597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 644/1286] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:03 2022] PUT /identity/v3/projects/61e5cce6874049ffbc45488597c6be30/users/56392b5a93bb44c2a859f3751902772e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:04.045005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbb96-eff7-4c1e-b9d6-4df8a224548d None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.045325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbb96-eff7-4c1e-b9d6-4df8a224548d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.045601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbfbb96-eff7-4c1e-b9d6-4df8a224548d None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.046955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 645/1287] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:04.052012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfbb96-eff7-4c1e-b9d6-4df8a224548d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.105097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 643/1288] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.106484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1065-5c46-43eb-9508-0ecabdb215bf None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.106734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1065-5c46-43eb-9508-0ecabdb215bf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.107063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b1065-5c46-43eb-9508-0ecabdb215bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.139436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e48b1065-5c46-43eb-9508-0ecabdb215bf None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.141006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e48b1065-5c46-43eb-9508-0ecabdb215bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.151324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 644/1289] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.152716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.153007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.153318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.157770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbfbb96-eff7-4c1e-b9d6-4df8a224548d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.163484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.164191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.164459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.164789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] PATH_INFO: `/v3/projects/9190b8ae84cf430ab0ea9b40fc280af7/users/d34642c11e2f4d53b89a181c982f657e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.174038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.175337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.182744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9190b8ae84cf430ab0ea9b40fc280af7, user_id=d34642c11e2f4d53b89a181c982f657e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.184866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 645/1290] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.185768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.186011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324268f-6b7e-4151-8456-200b0a692325 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.195634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de014c-3bae-4de4-aba3-2648bd4b8568 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.200708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.201389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.201794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.201923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] PATH_INFO: `/v3/projects/8b4298281fe0484fbd4d8cff40f3c161/users/26e6d0fc8c7f4958a70df08c00fb45a4/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.217531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4298281fe0484fbd4d8cff40f3c161, user_id=26e6d0fc8c7f4958a70df08c00fb45a4, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.220182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff389e46-463c-4aae-861a-c4ab684d336e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.289646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 646/1291] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:04 2022] PUT /identity/v3/projects/9190b8ae84cf430ab0ea9b40fc280af7/users/d34642c11e2f4d53b89a181c982f657e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:04.291040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547090-a519-4f96-994b-9fcf440ac41e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.291323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547090-a519-4f96-994b-9fcf440ac41e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.291598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4547090-a519-4f96-994b-9fcf440ac41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.312468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:04.314915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f4547090-a519-4f96-994b-9fcf440ac41e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.316666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f4547090-a519-4f96-994b-9fcf440ac41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.321541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 646/1292] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:04 2022] PUT /identity/v3/projects/8b4298281fe0484fbd4d8cff40f3c161/users/26e6d0fc8c7f4958a70df08c00fb45a4/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:04.324319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.324852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.325398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.370187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.371699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.384927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 647/1293] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.386230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.386524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.386803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.388353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 648/1294] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:04.389082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.391132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.451653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 647/1295] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.453009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.465800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ef5793-d5f0-45e3-a370-b454caa1a486 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.467485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dfa35-87d1-45db-a870-f12a1815819f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.473450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.474097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.474355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.474625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.476266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.476906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.477215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.477483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.487482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.488912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.489033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6ccba6-df04-4aff-aecd-1e9993a79230 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.491088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.500317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 649/1296] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:04.501872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.502267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.502609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.505277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 648/1297] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:04.511944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.516527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7fa1d-c0b0-4fb8-b585-1be9e79d5365 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.521321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.523422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.523709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.523982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.524634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.526301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556ac5-a908-4686-8af0-8e2a9442ca20 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.538146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 649/1298] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:04.539368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.540220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.540220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.543613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] MFA Rules not processed for user `d34642c11e2f4d53b89a181c982f657e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.544918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.559920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.561770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.571474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 650/1299] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.572301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.583192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45159e-170d-49f4-8e31-b7caa9baa343 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.589481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.590097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.590374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.590829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.601258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.602703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.613644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 650/1300] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:04.614498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 651/1301] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:04.614611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.615967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.627164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66284d2c-40aa-4418-8232-01cd1bc11141 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.628527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2c1a-85fb-46e8-b727-ece70e47232c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.632105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.632834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.633031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.633324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] PATH_INFO: `/v3/projects/8b4298281fe0484fbd4d8cff40f3c161/users/26e6d0fc8c7f4958a70df08c00fb45a4/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.634938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.635512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4298281fe0484fbd4d8cff40f3c161, user_id=26e6d0fc8c7f4958a70df08c00fb45a4, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.635658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.636057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.636616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.639605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.653338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 652/1302] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:04 2022] PUT /identity/v3/projects/8b4298281fe0484fbd4d8cff40f3c161/users/26e6d0fc8c7f4958a70df08c00fb45a4/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:04.654397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.704576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.706639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.721341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 651/1303] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:04.722600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:04.738720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b40d-fcf2-4a62-bbd6-e58c7c54ee11 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.752152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c5b0-1d94-4483-afa6-9c16e33c68da admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:04.760000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.761252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.762275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.762897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.775525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:04.821351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:04.823498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.824267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.824550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.825557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.828843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.844502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:04.844938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:04.846937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93aac5b-9468-4d71-a649-bb5179a32ba7 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:04.858716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 653/1304] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:04.860283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324efe4-9ec5-4a4b-833a-9c18a02e90eb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:04.860647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324efe4-9ec5-4a4b-833a-9c18a02e90eb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:04.861001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324efe4-9ec5-4a4b-833a-9c18a02e90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:04.899862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5324efe4-9ec5-4a4b-833a-9c18a02e90eb None None] MFA Rules not processed for user `26e6d0fc8c7f4958a70df08c00fb45a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:04.902219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5324efe4-9ec5-4a4b-833a-9c18a02e90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:04.934084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 652/1305] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/projects => generated 371 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:04.938184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.019087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 654/1306] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:05.024498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcf8f-75bb-4f47-85a9-eced73e79914 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.024498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcf8f-75bb-4f47-85a9-eced73e79914 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.024498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedcf8f-75bb-4f47-85a9-eced73e79914 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.024498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 655/1307] 10.222.0.50 () {54 vars in 912 bytes} [Wed Oct 12 12:41:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:05.029279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.029572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.029851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.044820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:05.050249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3875e0-df81-46fb-bb09-9a11951810e7 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.057319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:05.057451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.057563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:05.057654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.057654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.057654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.057654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.059598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.107813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:05.137453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 656/1308] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:05.138374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.167771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 653/1309] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:04 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:05.167771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.215081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733051e-3a95-4bd5-a8d0-cd3878cb0d32 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.218852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.219795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.220075 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.220496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.250547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88649b-6116-4614-8802-9e34575bdf8a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.254273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.254885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.255160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.255438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.266982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.268432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.280690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 654/1310] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:05.281628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.299685 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.301489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558997d3-9de9-4540-a196-e241215c1e1a service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.309251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9794336-e07b-4391-882f-724320ea74e1 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.325099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 657/1311] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:05.330849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac77de-906a-4f89-8c65-a0bbff05ee2b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.330849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac77de-906a-4f89-8c65-a0bbff05ee2b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.331183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac77de-906a-4f89-8c65-a0bbff05ee2b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.332959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 658/1312] 10.222.0.50 () {54 vars in 912 bytes} [Wed Oct 12 12:41:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:05.338394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.338683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.339011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.343643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.345847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.349057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.349057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.349057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.349785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.361560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 655/1313] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:05.366285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.380320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aedf6e-71b4-420c-8874-769788d69d53 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.386298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:05.387805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:05.389598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.390383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.390881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.391272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] PATH_INFO: `/v3/projects/3363caa101de471bbb7e3b0af121a418/users/5a2fa871e706438ba99a97b3b78aa908/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.412514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3363caa101de471bbb7e3b0af121a418, user_id=5a2fa871e706438ba99a97b3b78aa908, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.416056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.418941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 659/1314] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:05.543108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 656/1315] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:05 2022] PUT /identity/v3/projects/3363caa101de471bbb7e3b0af121a418/users/5a2fa871e706438ba99a97b3b78aa908/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:05.546474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.556595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.582154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29648e-8cd3-48a5-b10b-0fed10a5d364 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.632011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:05.632493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd1b4f-ae8a-4680-9dc8-f6afb17016ba admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.636744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.637724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.638519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.638519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.646354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.646888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.647202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.647638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.648343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.649922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.660713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 660/1316] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:05 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:05.665903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:05.685000 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74730c64-f2ed-4951-8770-3c948cc12711 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:05.690430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:05.692245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.692712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.693184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] PATH_INFO: `/v3/projects/3363caa101de471bbb7e3b0af121a418/users/5a2fa871e706438ba99a97b3b78aa908/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.695385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3363caa101de471bbb7e3b0af121a418, user_id=5a2fa871e706438ba99a97b3b78aa908, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.699818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f7e9b-2509-4e02-91ea-9dd64afa3429 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.701559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:05.717553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 661/1317] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:05 2022] PUT /identity/v3/projects/3363caa101de471bbb7e3b0af121a418/users/5a2fa871e706438ba99a97b3b78aa908/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:05.727156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114705-326b-4751-b5ac-9676da14859b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:05.727450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114705-326b-4751-b5ac-9676da14859b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:05.727872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f114705-326b-4751-b5ac-9676da14859b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:05.789045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:05.791234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:05.798078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9f114705-326b-4751-b5ac-9676da14859b None None] MFA Rules not processed for user `5a2fa871e706438ba99a97b3b78aa908`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:05.800088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9f114705-326b-4751-b5ac-9676da14859b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:05.812163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 657/1318] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:05.945700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 662/1319] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:06.387731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:06.396561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ae148-1032-4db4-98a3-327f93c7a9e2 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:06.446991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:06.447641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:06.447921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:06.448215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:06.457864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:06.459269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:06.473456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 658/1320] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:08.241901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114705-326b-4751-b5ac-9676da14859b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:08.436024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:08.489778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f114705-326b-4751-b5ac-9676da14859b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:08.505873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:08.506841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:08.507321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:08.507753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] PATH_INFO: `/v3/users/dd934777e6134421ab06aabb266ee4c0` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:08.511110 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd934777e6134421ab06aabb266ee4c0)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:08.515503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:08.606951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0b1a5-8ec8-4311-992d-6e17813f186b service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:08.616024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:08.617748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:08.617748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:08.617748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] PATH_INFO: `/v3/users/d34642c11e2f4d53b89a181c982f657e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:08.619928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34642c11e2f4d53b89a181c982f657e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:08.621105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: WARNING py.warnings [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:41:08.621105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: warnings.warn(msg) Oct 12 12:41:08.621105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: Oct 12 12:41:08.626470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:08.833302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd934777e6134421ab06aabb266ee4c0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.845002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd934777e6134421ab06aabb266ee4c0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.846758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:08.864164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd934777e6134421ab06aabb266ee4c0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.865828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd934777e6134421ab06aabb266ee4c0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.936278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-87452659-714f-4294-b7d8-2c8772569c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd934777e6134421ab06aabb266ee4c0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.939035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34642c11e2f4d53b89a181c982f657e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.946574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 663/1321] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:08 2022] DELETE /identity/v3/users/dd934777e6134421ab06aabb266ee4c0 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:08.952954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad01589-713b-4143-a255-f2784400f179 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:08.953282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad01589-713b-4143-a255-f2784400f179 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:08.953562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad01589-713b-4143-a255-f2784400f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:08.976033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34642c11e2f4d53b89a181c982f657e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:08.977858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34642c11e2f4d53b89a181c982f657e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.035945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8ad01589-713b-4143-a255-f2784400f179 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:09.037378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8ad01589-713b-4143-a255-f2784400f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:09.055867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34642c11e2f4d53b89a181c982f657e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.108567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:09.126740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34642c11e2f4d53b89a181c982f657e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:09.174298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 664/1322] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:09.210418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad01589-713b-4143-a255-f2784400f179 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:09.212030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8ad01589-713b-4143-a255-f2784400f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:09.376766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad01589-713b-4143-a255-f2784400f179 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:09.409276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:09.410089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.410177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.410496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.445837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:09.451002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48050c31-7265-4c2b-98a1-0f9ff8979696 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:09.469047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 665/1323] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:09.478853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 659/1324] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:08 2022] DELETE /identity/v3/users/d34642c11e2f4d53b89a181c982f657e => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:09.483425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.483933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.484352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.522864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:09.556581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:09.727731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 666/1325] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:09.756482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:09.855839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e226c6-4e5d-4c36-bbd8-865669f24228 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:09.868603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:09.870679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:09.871927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:09.872573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:09.891251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:09.893513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e223a7d-9dc2-4af5-8ba7-6cd5b0c9d557 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:09.910452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 660/1326] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:10.411535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:10.414950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:10.438322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250f1cd-3d4c-4422-913c-e9ae90f0483e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:10.457856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:10.458535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:10.458833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:10.459396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] PATH_INFO: `/v3/users/bbb66502c4d64e4f8b01f3e0b2b7bf42` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:10.464351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb66502c4d64e4f8b01f3e0b2b7bf42)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:10.470212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:10.633910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:10.680572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb66502c4d64e4f8b01f3e0b2b7bf42'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.690218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb66502c4d64e4f8b01f3e0b2b7bf42'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.711057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb66502c4d64e4f8b01f3e0b2b7bf42'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.712559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb66502c4d64e4f8b01f3e0b2b7bf42'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.784883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb66502c4d64e4f8b01f3e0b2b7bf42'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:10.800096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 667/1327] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:10 2022] DELETE /identity/v3/users/bbb66502c4d64e4f8b01f3e0b2b7bf42 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:10.805396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:10.805888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:10.806557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:10.859853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:10.862096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:10.983175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 661/1328] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:11.018185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:11.022628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:11.052018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd18bed-de26-48c3-bf5e-769cb90f3a8e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:11.058101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:11.059787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:11.102025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:11.102695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:11.102974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:11.103245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] PATH_INFO: `/v3/projects/9190b8ae84cf430ab0ea9b40fc280af7` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:11.105983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9190b8ae84cf430ab0ea9b40fc280af7)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:11.107029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: WARNING py.warnings [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 12 12:41:11.107029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: warnings.warn(msg) Oct 12 12:41:11.107029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: Oct 12 12:41:11.112668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:11.294819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe669e5-4817-416a-a430-5ef65c74b41d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:11.301930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:11.303036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:11.303564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:11.304079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:11.321900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:11.323757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:11.343821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 662/1329] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:11.359847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:11.361834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:11.396201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51882797-6e0a-476d-953f-8738f2802c08 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:11.398251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9190b8ae84cf430ab0ea9b40fc280af7', 'request_id': 'req-db15411f-3400-47b2-9db0-b1ef67970920'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.436815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9190b8ae84cf430ab0ea9b40fc280af7', 'request_id': 'req-db15411f-3400-47b2-9db0-b1ef67970920'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.476990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:11.568860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9190b8ae84cf430ab0ea9b40fc280af7', 'request_id': 'req-db15411f-3400-47b2-9db0-b1ef67970920'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.594398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:11.598170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:11.599578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:11.601498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] PATH_INFO: `/v3/projects/4a74d9f284c743b29408608233030036` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:11.607613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a74d9f284c743b29408608233030036)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:11.609908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:11.621034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] The token cache is being invalidate because project 9190b8ae84cf430ab0ea9b40fc280af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:11.628159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.628159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.640619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 668/1330] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:11 2022] DELETE /identity/v3/projects/9190b8ae84cf430ab0ea9b40fc280af7 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:11.652526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:11.674192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:11.741146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15411f-3400-47b2-9db0-b1ef67970920 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:11.754360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:11.755041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:11.757671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:11.758256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] PATH_INFO: `/v3/users/5a2fa871e706438ba99a97b3b78aa908` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:11.759369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2fa871e706438ba99a97b3b78aa908)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:11.765945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:11.870591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a74d9f284c743b29408608233030036', 'request_id': 'req-977bdd43-66e7-4ff7-9653-37909bab9ad0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.884508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a74d9f284c743b29408608233030036', 'request_id': 'req-977bdd43-66e7-4ff7-9653-37909bab9ad0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:11.908211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a74d9f284c743b29408608233030036', 'request_id': 'req-977bdd43-66e7-4ff7-9653-37909bab9ad0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.047762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] The token cache is being invalidate because project 4a74d9f284c743b29408608233030036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:12.047762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.047762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.047762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 663/1331] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:11 2022] DELETE /identity/v3/projects/4a74d9f284c743b29408608233030036 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:12.052038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:12.056660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:12.099238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2fa871e706438ba99a97b3b78aa908'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.115390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2fa871e706438ba99a97b3b78aa908'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.147276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2fa871e706438ba99a97b3b78aa908'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.152994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2fa871e706438ba99a97b3b78aa908'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.211233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bdd43-66e7-4ff7-9653-37909bab9ad0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:12.222302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:12.223606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:12.224395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:12.225034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] PATH_INFO: `/v3/users/26e6d0fc8c7f4958a70df08c00fb45a4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:12.226566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] RBAC: Authorizing `identity:delete_user(user_id=26e6d0fc8c7f4958a70df08c00fb45a4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:12.229157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:12.261424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2fa871e706438ba99a97b3b78aa908'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.272778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 669/1332] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:11 2022] DELETE /identity/v3/users/5a2fa871e706438ba99a97b3b78aa908 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:12.524218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26e6d0fc8c7f4958a70df08c00fb45a4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.551582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26e6d0fc8c7f4958a70df08c00fb45a4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.555308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26e6d0fc8c7f4958a70df08c00fb45a4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.593038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=74,keystone:DELETE=24,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:12.660855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26e6d0fc8c7f4958a70df08c00fb45a4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.694684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26e6d0fc8c7f4958a70df08c00fb45a4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:12.714315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 664/1333] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:12 2022] DELETE /identity/v3/users/26e6d0fc8c7f4958a70df08c00fb45a4 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:12.856937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:14.002795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:14.004409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:14.082301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc3450-2009-46a8-add2-704e27ebfd45 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:14.140352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:14.146445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:14.237958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:14.238528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:14.239185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:14.239616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] PATH_INFO: `/v3/users/29bf13dace764361a2dc8f4d1a3281c1` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:14.242215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29bf13dace764361a2dc8f4d1a3281c1)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:14.244640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:14.317312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8df4cd-eaa2-4ee3-920c-2f72a85c921b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:14.325248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:14.326201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:14.326672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:14.327136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] PATH_INFO: `/v3/projects/3363caa101de471bbb7e3b0af121a418` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:14.331643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3363caa101de471bbb7e3b0af121a418)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:14.334076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:14.553554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29bf13dace764361a2dc8f4d1a3281c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.578703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3363caa101de471bbb7e3b0af121a418', 'request_id': 'req-61830abc-5d36-4a26-a2f5-03762574037f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.595097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29bf13dace764361a2dc8f4d1a3281c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.600062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3363caa101de471bbb7e3b0af121a418', 'request_id': 'req-61830abc-5d36-4a26-a2f5-03762574037f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.649434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3363caa101de471bbb7e3b0af121a418', 'request_id': 'req-61830abc-5d36-4a26-a2f5-03762574037f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.670573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29bf13dace764361a2dc8f4d1a3281c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.672668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29bf13dace764361a2dc8f4d1a3281c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.773987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] The token cache is being invalidate because project 3363caa101de471bbb7e3b0af121a418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:14.775072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.776969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.781016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 665/1334] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:14 2022] DELETE /identity/v3/projects/3363caa101de471bbb7e3b0af121a418 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:14.784618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:14.792507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:14.858055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29bf13dace764361a2dc8f4d1a3281c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:14.873603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 670/1335] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:14 2022] DELETE /identity/v3/users/29bf13dace764361a2dc8f4d1a3281c1 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:14.875276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:14.879741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.026330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61830abc-5d36-4a26-a2f5-03762574037f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:15.129319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc053-9d5e-418b-aeb4-a56452a52018 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:15.148467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:15.149466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.149861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.150749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] PATH_INFO: `/v3/projects/8b4298281fe0484fbd4d8cff40f3c161` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.153959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4298281fe0484fbd4d8cff40f3c161)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:15.160253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:15.164467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:15.210141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:15.215050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:15.218400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.218400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.218400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] PATH_INFO: `/v3/projects/2e169b5ab8424947a018938ded2b67bf` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.218400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e169b5ab8424947a018938ded2b67bf)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:15.220199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:15.365002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4298281fe0484fbd4d8cff40f3c161', 'request_id': 'req-ae40e70a-abdb-4143-b90f-6998ae4dc881'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.376032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4298281fe0484fbd4d8cff40f3c161', 'request_id': 'req-ae40e70a-abdb-4143-b90f-6998ae4dc881'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.398736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e169b5ab8424947a018938ded2b67bf', 'request_id': 'req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.412486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e169b5ab8424947a018938ded2b67bf', 'request_id': 'req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.422767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e169b5ab8424947a018938ded2b67bf', 'request_id': 'req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.438941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4298281fe0484fbd4d8cff40f3c161', 'request_id': 'req-ae40e70a-abdb-4143-b90f-6998ae4dc881'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.459179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] The token cache is being invalidate because project 8b4298281fe0484fbd4d8cff40f3c161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:15.459708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.461635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ae40e70a-abdb-4143-b90f-6998ae4dc881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.467495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 671/1336] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:14 2022] DELETE /identity/v3/projects/8b4298281fe0484fbd4d8cff40f3c161 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:15.470145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3a0f-9e85-4b55-942e-dff85b577327 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.470800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3a0f-9e85-4b55-942e-dff85b577327 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.471550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e3a0f-9e85-4b55-942e-dff85b577327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.527605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-df4e3a0f-9e85-4b55-942e-dff85b577327 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.530827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-df4e3a0f-9e85-4b55-942e-dff85b577327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.534065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] The token cache is being invalidate because project 2e169b5ab8424947a018938ded2b67bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:15.534065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.534643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8afaadb0-58b4-4eae-98a9-cbcd8ee87440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:15.536352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 666/1337] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:14 2022] DELETE /identity/v3/projects/2e169b5ab8424947a018938ded2b67bf => generated 0 bytes in 755 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:15.538455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba27d-a9f1-4b78-ae6a-1f989f7b71b6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.538918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba27d-a9f1-4b78-ae6a-1f989f7b71b6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.540289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ba27d-a9f1-4b78-ae6a-1f989f7b71b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.586677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-394ba27d-a9f1-4b78-ae6a-1f989f7b71b6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.588226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-394ba27d-a9f1-4b78-ae6a-1f989f7b71b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.654589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 672/1338] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.657527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da75c4-5c96-4d5d-8955-e0be3f6a9fba None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.657919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da75c4-5c96-4d5d-8955-e0be3f6a9fba None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.658382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da75c4-5c96-4d5d-8955-e0be3f6a9fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.710984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b8da75c4-5c96-4d5d-8955-e0be3f6a9fba None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.712260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b8da75c4-5c96-4d5d-8955-e0be3f6a9fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.737962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 667/1339] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.739458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f489f-a379-43fe-b3d4-c58c8ee7994e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.739798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f489f-a379-43fe-b3d4-c58c8ee7994e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.740078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f489f-a379-43fe-b3d4-c58c8ee7994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.757119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 673/1340] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.758600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787449f6-311e-4de5-807b-6007ad31f3c9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.761482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787449f6-311e-4de5-807b-6007ad31f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.761818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787449f6-311e-4de5-807b-6007ad31f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.793633 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-842f489f-a379-43fe-b3d4-c58c8ee7994e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.794880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-842f489f-a379-43fe-b3d4-c58c8ee7994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.810820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-787449f6-311e-4de5-807b-6007ad31f3c9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.814309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-787449f6-311e-4de5-807b-6007ad31f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.814417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 668/1341] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.814417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.814417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.814417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.830613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 674/1342] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.832049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.832179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.832457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.879436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.881736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:15.882941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.883421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:15.913705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 675/1343] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.914408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:15.921781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 669/1344] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:15.925153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:15.951742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb167f6-f933-4aca-9834-b386cfdbdcef None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:15.958710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6f4d4-460a-4768-93aa-ce355b67bc6b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:15.961869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:15.965422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.967935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.969287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.972869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:15.973216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:15.977277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:15.977990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:15.978192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:15.978315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:15.978531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:15.979202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:15.979504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:15.981158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.010397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 670/1345] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:16.011198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.018228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 676/1346] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:16.024816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.028497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:16.040101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeac732-e3e3-4f53-9a31-04f56a1df076 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.074437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.075231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.075514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.075792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.076472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:16.076780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.079167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.112647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 671/1347] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:16.113981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.147808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:16.158299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85214445-8e38-4f3c-97c5-5debf182dc5d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.168527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.169396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.169846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.170275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.171462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.175858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.197614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f25d3a-253f-413c-928e-09c1887190e3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.217392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.218039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.224056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.224209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.242744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:16.250370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.250370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.278013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 677/1348] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:16.279524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.303136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13d156-a1ed-45e6-87fd-054c561d0509 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.314403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.318036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.319812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.321700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.322702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.328049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3b547-94a8-48ab-8d12-fdf17c996d23 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.338017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 672/1349] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/projects => generated 405 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:16.339346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.477893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 678/1350] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:16.481053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.481772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.482054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.523843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20819a6f-4888-49d3-8725-c5da5c766999 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.566171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] MFA Rules not processed for user `1ac2e3720a324751bacef35327cc089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:16.571634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:16.680082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.680927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.681034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.687949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.688920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.691839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.777858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 679/1351] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:16.789749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.815576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f7576-2122-4cae-840f-a49cdbba93e8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:16.846173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 673/1352] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/projects => generated 363 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:16.847057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:16.859243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:16.859895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:16.860181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:16.860460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:16.861117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:16.870288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7a940-7606-460f-b045-5cd84facd7aa admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:16.997722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 680/1353] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/users => generated 303 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:17.000904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.002427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.002863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.013733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b119847-ee40-485b-8823-3645183f2046 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.035495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.036798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.037256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.037669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.039096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.041379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.066491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] MFA Rules not processed for user `1ac2e3720a324751bacef35327cc089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:17.068050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.166804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 681/1354] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:17.168660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.195652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fc163-0f9b-428e-9ff8-25092c2a9138 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.228448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 674/1355] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:16 2022] POST /identity/v3/users => generated 282 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:17.235265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.252906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.255434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.257707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.258356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.259983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.273588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.284882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbb073-f293-4ed9-acdf-5291cebc8e21 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.293519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:17.297157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.298184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.298796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.299286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.300156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.303504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.343919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 675/1356] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:17.344934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.346959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.406806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 682/1357] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:17 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:17.407778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.413707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.439361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba56e354-b961-4e5e-ba58-f0b8f2711cad admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.443540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:17.446754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.447487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.447871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.448222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] PATH_INFO: `/v3/projects/f74766b389da45b982bdf8c641ec7a8e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.449734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f74766b389da45b982bdf8c641ec7a8e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.456739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.490105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e987f-c994-4539-ae56-873bcb0a30f9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.498865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.498865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.498865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.499276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.513419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.516341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.535870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 676/1358] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:17.537533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.551121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf80a5-95b6-4f42-b002-ce5565f78bff service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.557305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.557927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.558202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.558475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.559177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.560791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.577660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 677/1359] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:17.579593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.593906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9400c861-e24f-439b-ad06-4cc4e9dd36ba admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.599417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.600067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.600967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.601458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.602112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.603806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.644867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f74766b389da45b982bdf8c641ec7a8e', 'request_id': 'req-f5732b4d-e363-4f16-859a-119d491ed1e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:17.657162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 678/1360] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:17.658401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.670684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f74766b389da45b982bdf8c641ec7a8e', 'request_id': 'req-f5732b4d-e363-4f16-859a-119d491ed1e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:17.680762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e4ed75-7ca6-48e3-83af-52ec11881a28 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.775294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f74766b389da45b982bdf8c641ec7a8e', 'request_id': 'req-f5732b4d-e363-4f16-859a-119d491ed1e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:17.800059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] The token cache is being invalidate because project f74766b389da45b982bdf8c641ec7a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:17.800359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:17.803324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:17.815674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 683/1361] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:17 2022] DELETE /identity/v3/projects/f74766b389da45b982bdf8c641ec7a8e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:17.815674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.825662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.840919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.841619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.841905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.842181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.842846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.846616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.858842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5732b4d-e363-4f16-859a-119d491ed1e9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.871471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.873561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.876927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 679/1362] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:17.877201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.877201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.877201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.877489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.881112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75379baf-d7b2-4050-b9ea-0ff1dc870193 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.882500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.912061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 684/1363] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:17.916243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.916359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880c902-250b-4819-aa0e-e3f26b7f8f87 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:17.916467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.916814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.932606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:17.933862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:17.933984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:17.934238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] PATH_INFO: `/v3/projects/b89f5226947f44cea1508bb7b6701edb/users/a57333fabd384b62a4d8d77bb733d37f/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:17.966829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:17.969257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:17.981633 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89f5226947f44cea1508bb7b6701edb, user_id=a57333fabd384b62a4d8d77bb733d37f, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:17.986744 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:17.990430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 685/1364] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:17.992361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:17.996367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:18.032120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b2ae66-3914-4f96-86bb-d041f37c1e85 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.047712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.049095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.050556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.050920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.051672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:18.056316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68377306-65b5-4444-a2b2-81e1614064e9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:18.080120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 680/1365] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:17 2022] PUT /identity/v3/projects/b89f5226947f44cea1508bb7b6701edb/users/a57333fabd384b62a4d8d77bb733d37f/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:18.081481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:18.090437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 686/1366] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:18.092004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca39-bf8e-47b7-a75a-7cf1c8046a5d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.092289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca39-bf8e-47b7-a75a-7cf1c8046a5d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.093718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fca39-bf8e-47b7-a75a-7cf1c8046a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.146921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2a7fca39-bf8e-47b7-a75a-7cf1c8046a5d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:18.148606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2a7fca39-bf8e-47b7-a75a-7cf1c8046a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:18.237834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27280ff7-340e-4d96-89b3-0530d3c7b12a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.250670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.251505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.251884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.252317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] PATH_INFO: `/v3/projects/aa78b33e5ad44491bb2363bc124df6d4/users/f7ad09c5642349b9aa4085e0a2730a9d/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.274870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa78b33e5ad44491bb2363bc124df6d4, user_id=f7ad09c5642349b9aa4085e0a2730a9d, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:18.277722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:18.290519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:18.311493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 687/1367] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:18.311493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.311493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.311493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.368677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:18.370294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:18.371575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 681/1368] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:18 2022] PUT /identity/v3/projects/aa78b33e5ad44491bb2363bc124df6d4/users/f7ad09c5642349b9aa4085e0a2730a9d/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:18.375926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:18.459984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:18.503797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 688/1369] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:18.504680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:18.530129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599c52b-8b06-4d0c-a72e-3f5569761013 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.541792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.542583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.542960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.543505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.545859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096382b9-409c-406e-aca8-ce584a97acdd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.546695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:18.547128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:18.548992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaa2b4-93ca-4733-8734-d8e4f5af92bb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:18.561736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.562547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.562890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.563220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] PATH_INFO: `/v3/projects/1d4d932050af40688b12d61492096283/users/f80694966abe4b37815ccb8db42e5830/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.578831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 689/1370] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:18.581381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.581969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.582421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.600033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d4d932050af40688b12d61492096283, user_id=f80694966abe4b37815ccb8db42e5830, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:18.603619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:18.638932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] MFA Rules not processed for user `f7ad09c5642349b9aa4085e0a2730a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:18.641517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:18.709036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 682/1371] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:18 2022] PUT /identity/v3/projects/1d4d932050af40688b12d61492096283/users/f80694966abe4b37815ccb8db42e5830/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:18.726630 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:18.738397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:18.754993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 690/1372] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:18.759155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:18.781623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3449da0-32a9-432f-a87f-e2d04c4fa6b7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.909375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.909375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.909375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.909375 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:18.909770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:18.911997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d0da2-541e-4283-894a-e57be0f7fd08 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:18.972374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805f2d1-aeac-43d5-8c15-7495224b6466 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:18.977314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:18.978036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:18.978476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:18.978924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.023237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:19.034333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 691/1373] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:18 2022] POST /identity/v3/projects => generated 379 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90230-d201-43bc-8833-ef7e4acfccea None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90230-d201-43bc-8833-ef7e4acfccea None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab90230-d201-43bc-8833-ef7e4acfccea None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 692/1374] 10.222.0.50 () {54 vars in 912 bytes} [Wed Oct 12 12:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17e48a-038e-4b73-9fb0-ad77fcb3d72f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:19.110046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17e48a-038e-4b73-9fb0-ad77fcb3d72f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:19.110737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17e48a-038e-4b73-9fb0-ad77fcb3d72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.119169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 683/1375] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:19.124655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:19.186810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf98593-97ac-4844-8e05-9b322b0d5873 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:19.216698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6d17e48a-038e-4b73-9fb0-ad77fcb3d72f None None] MFA Rules not processed for user `f80694966abe4b37815ccb8db42e5830`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:19.221580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6d17e48a-038e-4b73-9fb0-ad77fcb3d72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:19.349706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:19.386336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:19.390165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:19.391459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:19.391645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.392269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:19.399252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:19.477636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 693/1376] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:19.479333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:19.483224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:19.493596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.550902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 684/1377] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:19 2022] POST /identity/v3/projects => generated 363 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:19.555696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:19.562566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:19.613543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:19.615071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:19.751356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 694/1378] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:41:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:19.755460 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c014fe1-b873-4221-ae76-cbc650b2df07 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:19.755699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:19.767461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:19.768099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:19.768376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:19.768647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:19.769339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:19.772908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a0814-0437-4639-8474-bb311c4feb03 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.124053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc15e4-f4c7-46d5-8f37-8b53168ec9b8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.124053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.124053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.124053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.135624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.135624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.135624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.138363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 685/1379] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:19 2022] POST /identity/v3/users => generated 290 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:20.138363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.138363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.138363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.141059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 695/1380] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:19 2022] POST /identity/v3/projects => generated 363 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:20.141059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.146887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] MFA Rules not processed for user `a50d4e2b72a045b0bf1e9afad975e1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:20.149115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:20.200279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae7c354-5a76-464c-9e45-8029792de2fa admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.214360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.215312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.218734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.218734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.218734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.222050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.279274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 686/1381] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:20.280115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.335956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 696/1382] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:20 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:20.337158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.356007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98be4713-3e6b-4735-a6b4-e338f36f1572 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.371627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.372286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.372571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.372841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.373671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.375755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.403171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 697/1383] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:20.404310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.407151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d1a5-6ecb-469b-97a6-a0c443f430fb None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.418097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.418732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.420174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.421330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.443738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449a3ad-416e-4e4f-b101-33630f4cb6b9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.451105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:20.457786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.461061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.461671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.465691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.465971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.466434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.467082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.471415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.483874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 687/1384] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:20.484789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.490624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:20.613582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 698/1385] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:20 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:20.613582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.615666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555a3f6-155c-4ae4-afbf-837c07a1f746 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.638491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.639823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.641475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.642411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.645801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae060bac-1d6a-4d7c-b390-0e6d0a7f8f8c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.679101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.679101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.679101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.679101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.679492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.679492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.679728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.679728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.706770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 688/1386] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:20.708774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.713495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 699/1387] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:20.714532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.734719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b43ca5-0a77-4f6b-9570-9e6c2f3b7beb service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.737782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bcf8c-1441-4193-a3f7-cfd9ea615750 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.745599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.746819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.748156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.748156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.749702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.750354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.755034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.755368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.757195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.757385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.759722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.765534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.787603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 689/1388] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:20.790240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.794445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 700/1389] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:20.794445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.816195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806b385-228f-4473-97b1-d5913f7b52bb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.816858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b02da-c3ca-4d27-9899-74309d9039a6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:20.828260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.829137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:20.830424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.831448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.832549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:20.833445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] PATH_INFO: `/v3/projects/8316296a0ace480e9ac0552b268f9a8c/users/c3f08cb76b9b4b6688bdbb3c18ad493f/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.834577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:20.835831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] PATH_INFO: `/v3/projects/771f879c2bb542db83bcad4500d88204/users/904287fab93e49b8806e4fbcf8121098/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:20.872093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8316296a0ace480e9ac0552b268f9a8c, user_id=c3f08cb76b9b4b6688bdbb3c18ad493f, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.873353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=771f879c2bb542db83bcad4500d88204, user_id=904287fab93e49b8806e4fbcf8121098, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:20.877811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.882663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:20.917306 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:20.962608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 690/1390] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:20 2022] PUT /identity/v3/projects/8316296a0ace480e9ac0552b268f9a8c/users/c3f08cb76b9b4b6688bdbb3c18ad493f/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:20.965395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:20.992529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 701/1391] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:20 2022] PUT /identity/v3/projects/771f879c2bb542db83bcad4500d88204/users/904287fab93e49b8806e4fbcf8121098/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:20.993469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:21.091979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b30a9-d3be-4228-b093-ea9793e1cb39 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:21.185163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:21.186524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.187092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.187679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] PATH_INFO: `/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132/users/cded70973e464a9782e94d91534a0308/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.203085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8069a3-5885-427d-8f49-319763e7a39b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:21.216183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:21.216826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.217758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33e4d3230a4425fbcf3e0b833ee9132, user_id=cded70973e464a9782e94d91534a0308, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:21.218806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.219750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.220483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:21.222133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:21.229185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11827d9-494d-4ed8-b4da-d30de12d081d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:21.264470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 702/1392] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:21.267321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.267776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.269663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.305869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 691/1393] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:20 2022] PUT /identity/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132/users/cded70973e464a9782e94d91534a0308/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:21.320433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:21.406703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] MFA Rules not processed for user `904287fab93e49b8806e4fbcf8121098`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:21.407275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:21.499014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754826c-c885-4206-9d3c-0f7b37cf5356 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:21.512028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:21.512688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.512980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.516741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] PATH_INFO: `/v3/projects/8316296a0ace480e9ac0552b268f9a8c/users/c3f08cb76b9b4b6688bdbb3c18ad493f/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.521001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8316296a0ace480e9ac0552b268f9a8c, user_id=c3f08cb76b9b4b6688bdbb3c18ad493f, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:21.538950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:21.575026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 692/1394] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:21 2022] PUT /identity/v3/projects/8316296a0ace480e9ac0552b268f9a8c/users/c3f08cb76b9b4b6688bdbb3c18ad493f/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:21.576391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:21.621252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 703/1395] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:21.622535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:21.625289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:21.713555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9209ddff-a519-40e2-92b8-08e53683655d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:21.725006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:21.725696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.725965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.726235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.726887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:21.728623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bb5a4-5896-4a34-afbf-f78fb283b90b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:21.777099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 693/1396] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:21.778680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:21.781887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:21.782540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:21.793246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b349c-20d1-4095-a372-aea81c4c20bc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:21.845513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:21.860663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] MFA Rules not processed for user `c3f08cb76b9b4b6688bdbb3c18ad493f`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:21.862582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.000768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.002599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.003049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.003461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.008450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.028325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 694/1397] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:22.030957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.035279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.037082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.048894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 704/1398] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:22.049894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.061848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55825b8d-8e17-401f-b090-ba6b2a8ce419 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.066128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451fd41-98ab-494b-9ae2-24c64577b9a0 service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.068189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.069069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.071417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.071896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.074522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.078928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.080225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.080225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.080225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] PATH_INFO: `/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132/users/cded70973e464a9782e94d91534a0308/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.084150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf913dc-6893-4d74-9ce0-364523c859c1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.085540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e33e4d3230a4425fbcf3e0b833ee9132, user_id=cded70973e464a9782e94d91534a0308, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.089768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb026b8-2d27-4ba1-b479-345dbb7808e2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.132976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 705/1399] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:22 2022] PUT /identity/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132/users/cded70973e464a9782e94d91534a0308/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:22.133845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.134720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.134720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.202026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 695/1400] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:22.202026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9cfd-46eb-476d-9008-26590d036c83 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.202026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9cfd-46eb-476d-9008-26590d036c83 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.202533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb9cfd-46eb-476d-9008-26590d036c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.205882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] MFA Rules not processed for user `1ac2e3720a324751bacef35327cc089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:22.207663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.278421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-95eb9cfd-46eb-476d-9008-26590d036c83 None None] MFA Rules not processed for user `a57333fabd384b62a4d8d77bb733d37f`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:22.279958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-95eb9cfd-46eb-476d-9008-26590d036c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.328586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 706/1401] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:22.330321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.333809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.455856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 696/1402] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:22.457496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.457780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.458055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.487525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630419d3-8ad9-4409-a605-faa10c9bd4fc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.500361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.500990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.501380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.501573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.535485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] MFA Rules not processed for user `cded70973e464a9782e94d91534a0308`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:22.537078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.543442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:22.635388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.637671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.656834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 707/1403] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:22.658951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.716546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 697/1404] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:22.716546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.773983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb35e22-9734-43ea-8a75-906b24c3a7f1 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.781819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.783369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.783656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.783931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.790458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.790458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.906168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e91d2-ccad-44c6-a577-115b4f9a2f34 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.916341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.921117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.921117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.921374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:22.922197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:22.927177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7226-c1b2-418a-94e5-53e43132a3c5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:22.946567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 708/1405] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:22.947573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:22.955233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:22.984233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5049abe6-61dc-43d9-a0e6-4efb999973a7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:22.990130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:22.990770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:22.991100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:22.991888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.016316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.018517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db80b9-3c88-411c-9b55-9515c183f043 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:23.043381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 709/1406] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:23.048734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.049030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.049331 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.081081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 698/1407] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:22 2022] POST /identity/v3/projects => generated 403 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:23.084713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.088959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.089402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.121625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] MFA Rules not processed for user `4eac367fb11f47c8b78ef739a63cc4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:23.124017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:23.180222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] MFA Rules not processed for user `56392b5a93bb44c2a859f3751902772e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:23.181844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:23.298019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 710/1408] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:23.298954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.334077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 699/1409] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:23.335724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.481476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de28b7-1b9c-4697-bb2c-583eb077d5af None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:23.495664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:23.496500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.496996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.497310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.497681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aea791-fd06-4e6d-b614-d2b087fea9af None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:23.498528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.500789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:23.502104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:23.503118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.503842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.504197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.536566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 711/1410] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:23.540062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.563801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8771bd-b892-4bf0-a81d-3d64c3905f68 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:23.587928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:23.588772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.589055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.595500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.595500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.595500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:23.610486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.612111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb3a5a6-d5bd-4976-928a-810f7043140b service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:23.621347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:23.628958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 700/1411] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:23.641270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.641564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.641844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.678411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] MFA Rules not processed for user `4eac367fb11f47c8b78ef739a63cc4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:23.680262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:23.693702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 701/1412] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:23.695399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.725591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 712/1413] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:23 2022] POST /identity/v3/users => generated 308 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:23.729312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.763001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f55cf-5e52-42cd-a460-612d76cd2f65 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:23.774507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:23.776992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.780228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.780386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.807051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:23.865304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac804c76-9171-44be-83ea-f7953eca9ff8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:23.890922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:23.890922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:23.890922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:23.890922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:23.917070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.919937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:23.950836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 702/1414] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:23.951887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:23.962711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:23.966190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.003229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 713/1415] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:24.004385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.005376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ee00e-b0de-4fe8-8196-1ab3f38989ee service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.025241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.025241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.031556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.032073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] PATH_INFO: `/v3/projects/a23a3cf765a543259dadcf718e64f94b/users/0c17b06a052f4674947b8e1374538d9a/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.048028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddda3d9-2dc8-4604-a1e1-79ab74a00dff service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.070449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.071607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.071971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.072250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.077332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.083812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.098557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23a3cf765a543259dadcf718e64f94b, user_id=0c17b06a052f4674947b8e1374538d9a, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.103693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.123901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 714/1416] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:24.123901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.129711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:24.168007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f871a-bbb1-40b1-89f6-fc3474b9de52 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.192761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.193757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.195724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.196835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.206782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.209876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.241594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 715/1417] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:24.242585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.257675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 703/1418] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:23 2022] PUT /identity/v3/projects/a23a3cf765a543259dadcf718e64f94b/users/0c17b06a052f4674947b8e1374538d9a/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:24.257977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9b2a9-928b-4571-81b5-ece85771a2bf service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.262759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.423384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.425931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.426368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.426982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] PATH_INFO: `/v3/projects/271af82d696d49bd808b7a8e1c24b1e3/users/3d741944257b441085f62cf786a81c99/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.448451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995fe29f-2eda-44fe-af0b-48b1653707d3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.462282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] RBAC: Authorizing `identity:create_grant(project_id=271af82d696d49bd808b7a8e1c24b1e3, user_id=3d741944257b441085f62cf786a81c99, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.469890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.471083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.473824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.477387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.477940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.478847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.480831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.515889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 704/1419] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:24.519880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.543056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706322e8-2ec4-4ad4-a7a9-325eb13a7576 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.556005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.556934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.559539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.560815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] PATH_INFO: `/v3/projects/a23a3cf765a543259dadcf718e64f94b/users/0c17b06a052f4674947b8e1374538d9a/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.565859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a23a3cf765a543259dadcf718e64f94b, user_id=0c17b06a052f4674947b8e1374538d9a, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.576640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502baa9-e9ee-439a-97cc-823e874a8a52 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.619753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 716/1420] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:24 2022] PUT /identity/v3/projects/271af82d696d49bd808b7a8e1c24b1e3/users/3d741944257b441085f62cf786a81c99/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:24.623849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.642399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 705/1421] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:24 2022] PUT /identity/v3/projects/a23a3cf765a543259dadcf718e64f94b/users/0c17b06a052f4674947b8e1374538d9a/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:24.657336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.657750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.660756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.769941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] MFA Rules not processed for user `0c17b06a052f4674947b8e1374538d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:24.771205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:24.788123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fec269-7c57-4e79-840e-86785c47c94f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.801707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.802720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.803196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.803454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.804852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.806576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.835323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 717/1422] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:24.836404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:24.849542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef67a-4e14-42d6-88be-faefcde1fd3b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:24.856131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:24.858334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:24.858334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:24.858334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] PATH_INFO: `/v3/projects/271af82d696d49bd808b7a8e1c24b1e3/users/3d741944257b441085f62cf786a81c99/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:24.861213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=271af82d696d49bd808b7a8e1c24b1e3, user_id=3d741944257b441085f62cf786a81c99, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:24.865580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:24.882423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 718/1423] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:24 2022] PUT /identity/v3/projects/271af82d696d49bd808b7a8e1c24b1e3/users/3d741944257b441085f62cf786a81c99/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:24.982830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 706/1424] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:24.989655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:25.244619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e7da78-9b85-4030-b01c-43230e398c3b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:25.264798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:25.265731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:25.267918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:25.268214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:25.334419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:25.402722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:25.454303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:25.454303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8813b2d5-ca19-44f2-89de-9a56a7a357ab service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:25.485191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 719/1425] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:25.989586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:26.133765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f8abb-3369-4e01-a4ca-6a947144892f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:26.142359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:26.143293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:26.143751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:26.144001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:26.352343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:26.357532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0482f3-57f5-48fe-92f4-5f243d3701c0 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:26.413846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 707/1426] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:27.117767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:27.118653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:27.119111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:27.180530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] MFA Rules not processed for user `a50d4e2b72a045b0bf1e9afad975e1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:27.185628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:27.194884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:27.337797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 720/1427] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:27.581930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:28.085896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cf13-4443-4fa3-8621-d98b6e51916b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:28.087194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cf13-4443-4fa3-8621-d98b6e51916b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:28.087653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436cf13-4443-4fa3-8621-d98b6e51916b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:28.166462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4436cf13-4443-4fa3-8621-d98b6e51916b None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:28.167867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4436cf13-4443-4fa3-8621-d98b6e51916b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:28.340210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 708/1428] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:28.728434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:28.729919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:28.971063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7bc0-6937-4575-a9b0-5b704cfed50c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:28.981327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:28.981327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:28.981327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:28.981327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:28.991357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:28.993264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a632525a-e8f8-4255-b0ac-0d9c768a68e3 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:29.020569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9197-467c-4a42-af76-df2717b58160 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:29.021060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9197-467c-4a42-af76-df2717b58160 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:29.021514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c9197-467c-4a42-af76-df2717b58160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:29.031159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 721/1429] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:41:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:41:29.111621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d25c9197-467c-4a42-af76-df2717b58160 None None] MFA Rules not processed for user `3d741944257b441085f62cf786a81c99`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:29.114467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d25c9197-467c-4a42-af76-df2717b58160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:29.296555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:29.387649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 709/1430] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:29.490198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:29.490659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:29.491095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:29.494571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 722/1431] 10.222.0.50 () {54 vars in 912 bytes} [Wed Oct 12 12:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:29.510776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:29.511304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:29.511791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:29.578247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:29.579973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:29.722338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:29.797094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 710/1432] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:29.908022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:29.911802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:29.938781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dde2c1-6ad6-465b-afa9-9ac22d7c5051 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:29.953310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:29.954251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:29.954688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:29.955130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:30.080819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:30.080819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c2d05-2a1c-455a-875b-d17e5f0523ab service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:30.080819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 723/1433] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:30.492663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:30.714597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f216f02-8dd6-4f41-9311-1c101554b10a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:30.732091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:30.733061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:30.735106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:30.737505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] PATH_INFO: `/v3/users/f7ad09c5642349b9aa4085e0a2730a9d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:30.748172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ad09c5642349b9aa4085e0a2730a9d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:30.757218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:31.043268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ad09c5642349b9aa4085e0a2730a9d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:31.064778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ad09c5642349b9aa4085e0a2730a9d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:31.067136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ad09c5642349b9aa4085e0a2730a9d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:31.164965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ad09c5642349b9aa4085e0a2730a9d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:31.223576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6eaf8f34-bd82-4a54-8a06-69bb37c66a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ad09c5642349b9aa4085e0a2730a9d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:31.270788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 711/1434] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:30 2022] DELETE /identity/v3/users/f7ad09c5642349b9aa4085e0a2730a9d => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:31.272199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:31.273846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:31.274379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:31.367304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:31.371280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:31.433298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:31.438499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:31.438499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:31.493428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:31.546596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:31.549331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:31.562775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 724/1435] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:31.739917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 712/1436] 10.222.0.46 () {58 vars in 1015 bytes} [Wed Oct 12 12:41:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:31.820029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:31.820029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:31.839262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fafdd8-6464-438f-b1e8-2c3b6ee2ec3f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:31.861648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:31.862809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:31.863328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:31.863621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:31.926610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:31.930940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c5420-2a7e-4855-9be9-a563438090d7 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:31.997274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 725/1437] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:32.095742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:32.115317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a9a5b-392c-4ad5-adbc-a7b01589b3ce None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:32.130798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:32.133960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:32.143059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:32.143059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:32.163283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:32.165179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:32.171646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620d6b5d-bbd6-438b-9ac2-a173da2f71c8 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:32.200595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 713/1438] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:32.374564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:32.375072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:32.375153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:32.417746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] MFA Rules not processed for user `56392b5a93bb44c2a859f3751902772e`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:32.421006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:32.423148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b97c-7ecf-49f6-87e5-2c7da0cc8981 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:32.425741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b97c-7ecf-49f6-87e5-2c7da0cc8981 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:32.426256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd9b97c-7ecf-49f6-87e5-2c7da0cc8981 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:32.428443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 714/1439] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:41:32.483129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:32.494677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:32.495201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:32.495959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:32.544827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:32.548022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:32.626353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 726/1440] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:32.823063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 715/1441] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:32.875493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:32.878025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:32.945779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f088b-7b2c-4dcb-9946-42f26ba0875d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:32.957719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:32.958864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:32.961091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:32.961768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:32.978174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:32.981947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:32.996692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 727/1442] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:35.155153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:35.156560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:35.172833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b2c5a-b9f0-4610-8772-687bbcec9e0b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:35.186814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:35.187852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:35.188293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:35.188767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] PATH_INFO: `/v3/projects/aa78b33e5ad44491bb2363bc124df6d4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:35.190587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa78b33e5ad44491bb2363bc124df6d4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:35.194135 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:35.378168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:35.406340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa78b33e5ad44491bb2363bc124df6d4', 'request_id': 'req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:35.435254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa78b33e5ad44491bb2363bc124df6d4', 'request_id': 'req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:35.455009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa78b33e5ad44491bb2363bc124df6d4', 'request_id': 'req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:35.599475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] The token cache is being invalidate because project aa78b33e5ad44491bb2363bc124df6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:35.599773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:35.603568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:35.618956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 716/1443] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:35 2022] DELETE /identity/v3/projects/aa78b33e5ad44491bb2363bc124df6d4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:35.624682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:35.638391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2abbf1-025e-431f-bdec-c95dbb0ff99e service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:35.738820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:35.740240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:35.740532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:35.742878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] PATH_INFO: `/v3/users/c3f08cb76b9b4b6688bdbb3c18ad493f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:35.745194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f08cb76b9b4b6688bdbb3c18ad493f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:35.747946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:35.978411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f08cb76b9b4b6688bdbb3c18ad493f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:36.000315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f08cb76b9b4b6688bdbb3c18ad493f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:36.017968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f08cb76b9b4b6688bdbb3c18ad493f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:36.019156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f08cb76b9b4b6688bdbb3c18ad493f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:36.125829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b93a67ff-6d41-4e95-a443-8466e8c98f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f08cb76b9b4b6688bdbb3c18ad493f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:36.138995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 728/1444] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:35 2022] DELETE /identity/v3/users/c3f08cb76b9b4b6688bdbb3c18ad493f => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:36.345269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:36.348433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:36.375425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1fe0-2ee3-4131-a7bc-4a0f08830bc3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:36.437046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d7e8-69fe-411f-a601-9d3e8533442b None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.437451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d7e8-69fe-411f-a601-9d3e8533442b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.437899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283d7e8-69fe-411f-a601-9d3e8533442b None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.439715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 729/1445] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:41:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:36.514893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:36.514893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.514893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.514893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] PATH_INFO: `/v3/users/f80694966abe4b37815ccb8db42e5830` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.515971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80694966abe4b37815ccb8db42e5830)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:36.518234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:36.564848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904425-1492-463e-bbaf-3c421e63e034 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.565398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904425-1492-463e-bbaf-3c421e63e034 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.565865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72904425-1492-463e-bbaf-3c421e63e034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.616365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-72904425-1492-463e-bbaf-3c421e63e034 None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:36.658721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-72904425-1492-463e-bbaf-3c421e63e034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:36.677324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:36.791671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 730/1446] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:36.815280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ad7-e033-44b4-b4ff-57a5a0efb13a None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.815488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ad7-e033-44b4-b4ff-57a5a0efb13a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.815693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386ad7-e033-44b4-b4ff-57a5a0efb13a None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.817381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 731/1447] 10.222.0.50 () {54 vars in 961 bytes} [Wed Oct 12 12:41:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:41:36.825687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.826008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.826238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.862722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] MFA Rules not processed for user `b97ffadf3cd944069d1822826ac35e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:36.863985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:36.882370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 732/1448] 10.222.0.50 () {58 vars in 1058 bytes} [Wed Oct 12 12:41:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:36.890389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:36.919001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb33f20-5f88-4cd6-8264-37ab71b2e95c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:36.932179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:36.933729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:36.934026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:36.934308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:36.959503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:36.962005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11d37b-fa5f-4498-8420-0912fd01bc05 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:36.994383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 733/1449] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:37.373986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80694966abe4b37815ccb8db42e5830'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:37.392440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80694966abe4b37815ccb8db42e5830'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:37.398429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80694966abe4b37815ccb8db42e5830'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:37.515848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80694966abe4b37815ccb8db42e5830'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:37.545602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b42ccc0b-71fa-4e66-aaa1-9c8c7adebd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80694966abe4b37815ccb8db42e5830'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:37.560708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 717/1450] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:36 2022] DELETE /identity/v3/users/f80694966abe4b37815ccb8db42e5830 => generated 0 bytes in 1216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:37.565994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:37.566422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:37.567198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:37.620247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb3e5-7e01-489b-b2f4-f5ab861e37f6 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:37.620687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb3e5-7e01-489b-b2f4-f5ab861e37f6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:37.621068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0eb3e5-7e01-489b-b2f4-f5ab861e37f6 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:37.622837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 718/1451] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:41:37.625698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:37.642721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:37.643007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:37.643298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:37.660458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:37.681352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:37.683901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:37.886361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 719/1452] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 12 12:41:37.887458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:37.889383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:37.893156 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 734/1453] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:37.906745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:37.909873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59babfb4-e7d3-4288-b97c-f7995d6568b1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:37.910022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:37.917994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:37.918908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:37.919233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:37.919504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] PATH_INFO: `/v3/users/a57333fabd384b62a4d8d77bb733d37f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:37.921422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57333fabd384b62a4d8d77bb733d37f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:37.925506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:37.934628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdba0d6-b972-4513-b593-0eaaaff90b51 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:37.940889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:37.941752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:37.942148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:37.942518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:37.955695 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:37.957666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:37.984437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 735/1454] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:37.985548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:37.991006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:38.201549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3f7d1-7f38-47a0-af95-8e6da905c56a service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:38.213936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57333fabd384b62a4d8d77bb733d37f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:38.215979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:38.216614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:38.216901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:38.217711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:38.226544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57333fabd384b62a4d8d77bb733d37f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:38.227812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57333fabd384b62a4d8d77bb733d37f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:38.232467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:38.234359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbfdbf-7b16-4b06-a8e3-67938e2a7004 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:38.261071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 736/1455] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:38.302512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57333fabd384b62a4d8d77bb733d37f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:38.326734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:38.342554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3a20d8cc-8e28-45fa-aa7e-f73f466f74b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57333fabd384b62a4d8d77bb733d37f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:38.357196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 720/1456] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:37 2022] DELETE /identity/v3/users/a57333fabd384b62a4d8d77bb733d37f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:38.394752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:38.395040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:38.395305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:38.396831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 737/1457] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:41:38.414476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:38.415432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:38.415863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:38.454916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:38.456494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:38.605028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 721/1458] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:41:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:39.192942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:39.195325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:39.234903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7f7fbb-fb04-4988-8913-72d4fea86ea7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:39.241979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:39.244805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:39.251248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:39.251897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:39.261637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:39.263445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:39.282850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:39.284539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:39.355956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 738/1459] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:39.520480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d075f9f-439b-4e07-8346-2f6aba124efd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:39.535392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:39.536208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:39.536495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:39.536773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] PATH_INFO: `/v3/projects/8316296a0ace480e9ac0552b268f9a8c` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:39.540490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8316296a0ace480e9ac0552b268f9a8c)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:39.544321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:39.668678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:39.672194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:39.719731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d379bb4-1158-4e90-9979-c2c8a1349e68 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:39.771601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8316296a0ace480e9ac0552b268f9a8c', 'request_id': 'req-8a303564-c5b2-48f1-870a-be8003d2a5fb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:39.778150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:39.795777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8316296a0ace480e9ac0552b268f9a8c', 'request_id': 'req-8a303564-c5b2-48f1-870a-be8003d2a5fb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:39.814148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8316296a0ace480e9ac0552b268f9a8c', 'request_id': 'req-8a303564-c5b2-48f1-870a-be8003d2a5fb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:39.821043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:39.866488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:39.873984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:39.874212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:39.874477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] PATH_INFO: `/v3/projects/b89f5226947f44cea1508bb7b6701edb` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:39.875851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89f5226947f44cea1508bb7b6701edb)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:39.878039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:40.341464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] The token cache is being invalidate because project 8316296a0ace480e9ac0552b268f9a8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:40.341871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.342956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.349582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 722/1460] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:39 2022] DELETE /identity/v3/projects/8316296a0ace480e9ac0552b268f9a8c => generated 0 bytes in 1084 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:40.351410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:40.353872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:40.399584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a303564-c5b2-48f1-870a-be8003d2a5fb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:40.429163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89f5226947f44cea1508bb7b6701edb', 'request_id': 'req-b821540d-169b-43fe-8bf3-88b003e35770'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.451605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89f5226947f44cea1508bb7b6701edb', 'request_id': 'req-b821540d-169b-43fe-8bf3-88b003e35770'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.544885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:40.546316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:40.546759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:40.547191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] PATH_INFO: `/v3/users/904287fab93e49b8806e4fbcf8121098` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:40.548627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=904287fab93e49b8806e4fbcf8121098)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:40.550888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:40.709247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89f5226947f44cea1508bb7b6701edb', 'request_id': 'req-b821540d-169b-43fe-8bf3-88b003e35770'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.753797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] The token cache is being invalidate because project b89f5226947f44cea1508bb7b6701edb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:40.754097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.760841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b821540d-169b-43fe-8bf3-88b003e35770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:40.765954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 739/1461] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:39 2022] DELETE /identity/v3/projects/b89f5226947f44cea1508bb7b6701edb => generated 0 bytes in 1095 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:40.773174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17018d-c918-4ec9-a793-2686172911de None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:40.773763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17018d-c918-4ec9-a793-2686172911de None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:40.774228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17018d-c918-4ec9-a793-2686172911de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:40.847566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9b17018d-c918-4ec9-a793-2686172911de None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:40.849821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9b17018d-c918-4ec9-a793-2686172911de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:40.885076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 740/1462] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:40.885076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17018d-c918-4ec9-a793-2686172911de None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:40.890185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9b17018d-c918-4ec9-a793-2686172911de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:40.914496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17018d-c918-4ec9-a793-2686172911de None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:40.929784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:40.936748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:40.936748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:40.936748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] PATH_INFO: `/v3/projects/1d4d932050af40688b12d61492096283` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:40.936748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d4d932050af40688b12d61492096283)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:40.936748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:41.106198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904287fab93e49b8806e4fbcf8121098'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.114097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904287fab93e49b8806e4fbcf8121098'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.114942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904287fab93e49b8806e4fbcf8121098'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.214162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904287fab93e49b8806e4fbcf8121098'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.238376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904287fab93e49b8806e4fbcf8121098'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.240525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d4d932050af40688b12d61492096283', 'request_id': 'req-1dc65d24-693f-42a1-bd10-73bbf522498b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.247744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d4d932050af40688b12d61492096283', 'request_id': 'req-1dc65d24-693f-42a1-bd10-73bbf522498b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.262826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 723/1463] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:40 2022] DELETE /identity/v3/users/904287fab93e49b8806e4fbcf8121098 => generated 0 bytes in 912 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:41.266725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:41.268712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:41.325926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d4d932050af40688b12d61492096283', 'request_id': 'req-1dc65d24-693f-42a1-bd10-73bbf522498b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.343294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] The token cache is being invalidate because project 1d4d932050af40688b12d61492096283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:41.343682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.344600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1dc65d24-693f-42a1-bd10-73bbf522498b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.346647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 741/1464] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:40 2022] DELETE /identity/v3/projects/1d4d932050af40688b12d61492096283 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:41.348004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641522-ae4d-4095-8523-1c996c63a676 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:41.348372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641522-ae4d-4095-8523-1c996c63a676 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:41.348738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7641522-ae4d-4095-8523-1c996c63a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:41.375183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b7641522-ae4d-4095-8523-1c996c63a676 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:41.377582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b7641522-ae4d-4095-8523-1c996c63a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:41.399788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 742/1465] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:41.404386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:41.404807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:41.405417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:41.406016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca244e6b-a446-4889-a3a8-76a858811ffc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:41.419969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:41.419969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:41.419969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:41.419969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] PATH_INFO: `/v3/users/3d741944257b441085f62cf786a81c99` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:41.423884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d741944257b441085f62cf786a81c99)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:41.426064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:41.443044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:41.443044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:41.452097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 743/1466] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:41.453293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:41.454889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:41.472161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e9b86-722d-483d-bdd6-3ad92b6d5430 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:41.478151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:41.479095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:41.479389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:41.479667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] PATH_INFO: `/v3/users/cded70973e464a9782e94d91534a0308` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:41.480878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cded70973e464a9782e94d91534a0308)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:41.483420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:41.511131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:41.935151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d741944257b441085f62cf786a81c99'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.945577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d741944257b441085f62cf786a81c99'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.946322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d741944257b441085f62cf786a81c99'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.980521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cded70973e464a9782e94d91534a0308'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.990246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cded70973e464a9782e94d91534a0308'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:41.999998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cded70973e464a9782e94d91534a0308'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.000738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cded70973e464a9782e94d91534a0308'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.050177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d741944257b441085f62cf786a81c99'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.062969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d741944257b441085f62cf786a81c99'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.068878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 724/1467] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:41 2022] DELETE /identity/v3/users/3d741944257b441085f62cf786a81c99 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:42.069704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.071041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.118860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cded70973e464a9782e94d91534a0308'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.121326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:42.128406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 744/1468] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:41 2022] DELETE /identity/v3/users/cded70973e464a9782e94d91534a0308 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:42.128406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.132334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.163229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635795af-9d0a-4994-a1f0-9d3e995151e9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.201525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a3568-0fc8-4ef8-af0b-28262b8f4f41 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.206217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.207227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.207878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.208407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.212207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.248649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.249309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.249596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.249873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.250529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:42.250834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.252622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.265752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 725/1469] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:42.270084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.272093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.285168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27cac8-514e-40b7-91f1-5ed724ca57e6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.286618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.288089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.290608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.291205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.291486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.291760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.292402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.294315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.298418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 745/1470] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:42.352593 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.354485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.371126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db74af-beff-44b7-ae2c-6c5c6eed4e50 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.376036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.376731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.377009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.377411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] PATH_INFO: `/v3/projects/271af82d696d49bd808b7a8e1c24b1e3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.378565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] RBAC: Authorizing `identity:delete_project(project_id=271af82d696d49bd808b7a8e1c24b1e3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.380666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.417354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 726/1471] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:42 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:42.421352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.483457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bf8c5-4924-41a8-bb46-9827a8d19395 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.495878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.495878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.495878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.495878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.496219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.496219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.507760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271af82d696d49bd808b7a8e1c24b1e3', 'request_id': 'req-89d557a1-5bed-456c-a21f-0aa25a49992c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.514663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271af82d696d49bd808b7a8e1c24b1e3', 'request_id': 'req-89d557a1-5bed-456c-a21f-0aa25a49992c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.581771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 727/1472] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:42 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:42.591054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.607248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7959604-cf00-41f5-90ff-78bf738674eb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.633947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271af82d696d49bd808b7a8e1c24b1e3', 'request_id': 'req-89d557a1-5bed-456c-a21f-0aa25a49992c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.652182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] The token cache is being invalidate because project 271af82d696d49bd808b7a8e1c24b1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:42.652480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.655763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-89d557a1-5bed-456c-a21f-0aa25a49992c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:42.662844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 746/1473] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:42 2022] DELETE /identity/v3/projects/271af82d696d49bd808b7a8e1c24b1e3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:42.666797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.668297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.673022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.720194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.721329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.721816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.722277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.723337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.725284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.728310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:42.729177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.738745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 747/1474] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:42.739857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.740974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 728/1475] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:42.742805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.748512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.749927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.763347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef4be-e0dc-4325-b94c-3fd3028e93e2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.763548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f24de72-cbd6-4cf7-868d-832deb541378 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.769813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.770676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.771406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.771968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.772900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.774849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cf769c-f539-403f-b2ea-fb46da1e535b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.776229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.777369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.777648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.778155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] PATH_INFO: `/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.779521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e33e4d3230a4425fbcf3e0b833ee9132)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.782885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.792540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 729/1476] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:42.794764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.795252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.795975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.826089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:42.827573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:42.838700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 730/1477] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:42.843012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:42.853527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55dda28-08f6-4821-b0d9-1b6026c9bef3 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:42.858933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:42.859787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:42.860169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:42.860538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] PATH_INFO: `/v3/projects/40614bc7b1c04a4080a2ce6f4cd8962d/users/91e14965b0214eab90b6e897cbb0acbe/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:42.876465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40614bc7b1c04a4080a2ce6f4cd8962d, user_id=91e14965b0214eab90b6e897cbb0acbe, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:42.879331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:42.994852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 731/1478] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:42 2022] PUT /identity/v3/projects/40614bc7b1c04a4080a2ce6f4cd8962d/users/91e14965b0214eab90b6e897cbb0acbe/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:43.006046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.033090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e33e4d3230a4425fbcf3e0b833ee9132', 'request_id': 'req-a4ce9249-683f-4116-9d8e-110ced881c4f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.044673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e33e4d3230a4425fbcf3e0b833ee9132', 'request_id': 'req-a4ce9249-683f-4116-9d8e-110ced881c4f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.098529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd6ac6-fd3a-4abb-9286-c3782417fb00 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.162605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e33e4d3230a4425fbcf3e0b833ee9132', 'request_id': 'req-a4ce9249-683f-4116-9d8e-110ced881c4f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.167024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.167893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.171816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.171816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.171816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:43.171816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.172993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.181615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] The token cache is being invalidate because project e33e4d3230a4425fbcf3e0b833ee9132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:43.182144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.183694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a4ce9249-683f-4116-9d8e-110ced881c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.186360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 748/1479] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:42 2022] DELETE /identity/v3/projects/e33e4d3230a4425fbcf3e0b833ee9132 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:43.188478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119545fc-f3bf-461f-9c6f-346bd35e2d19 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.188906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119545fc-f3bf-461f-9c6f-346bd35e2d19 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.190725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119545fc-f3bf-461f-9c6f-346bd35e2d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.191349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 732/1480] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:43.192295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.195645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.228792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddfae3a-bef3-48f0-918b-0e1b2a7e3c93 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.237806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.239076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.239489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.239914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] PATH_INFO: `/v3/projects/771f879c2bb542db83bcad4500d88204` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.242378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771f879c2bb542db83bcad4500d88204)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.244556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.258208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-119545fc-f3bf-461f-9c6f-346bd35e2d19 None None] MFA Rules not processed for user `91e14965b0214eab90b6e897cbb0acbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:43.258208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-119545fc-f3bf-461f-9c6f-346bd35e2d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.282681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:43.343352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 749/1481] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:43.344984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.345459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.345864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.369417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771f879c2bb542db83bcad4500d88204', 'request_id': 'req-b4b4561f-504a-4364-9e80-0439a723a7c3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.369738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:43.370972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.375266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771f879c2bb542db83bcad4500d88204', 'request_id': 'req-b4b4561f-504a-4364-9e80-0439a723a7c3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.384123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771f879c2bb542db83bcad4500d88204', 'request_id': 'req-b4b4561f-504a-4364-9e80-0439a723a7c3'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.434120 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 750/1482] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:43.435306 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.436972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.449051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1323b89-7ed4-4480-b855-186257083f65 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.454065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.454697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.454968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.455245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.455881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.457889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a0a7f-1949-4b15-9190-1939f5344cb4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.468312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] The token cache is being invalidate because project 771f879c2bb542db83bcad4500d88204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:43.468606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.469302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.471878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 733/1483] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:43 2022] DELETE /identity/v3/projects/771f879c2bb542db83bcad4500d88204 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:43.476838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.476838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.487890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4561f-504a-4364-9e80-0439a723a7c3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.492932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.493599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.493884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.494164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.494922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.497024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.566220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 751/1484] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:43.567551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.567842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.568117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.588579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:43.589814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.629543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 734/1485] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:43.630387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.633549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.650499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 752/1486] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:43.651218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.652630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.666283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce784980-5c6f-4f9b-8165-360b5f52f7fc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.699112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c751593-6c8d-4c4b-830f-d434ca0d6cd3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.704074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.704706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.704983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.705286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] PATH_INFO: `/v3/users/0c17b06a052f4674947b8e1374538d9a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.706433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c17b06a052f4674947b8e1374538d9a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.708366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.721776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.722408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.722699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.722976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.723613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.725623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.827365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:43.832732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 753/1487] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/users => generated 287 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:43.833573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.843612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21342a36-c061-4744-9b48-a04a2700fe1c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.848205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:43.848799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:43.849064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:43.849369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:43.849988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:43.852542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:43.892693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c17b06a052f4674947b8e1374538d9a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.900134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c17b06a052f4674947b8e1374538d9a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.900876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c17b06a052f4674947b8e1374538d9a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:43.961307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 754/1488] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:43 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:43.965107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:43.966820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:43.979224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c330a3-d45b-45e1-b22b-8314943c67bf admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:43.987231 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c17b06a052f4674947b8e1374538d9a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:44.003711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.004735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.005224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.005662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.006215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c17b06a052f4674947b8e1374538d9a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:44.006668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:44.006668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.008775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.023543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 735/1489] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:43 2022] DELETE /identity/v3/users/0c17b06a052f4674947b8e1374538d9a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:44.023543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.033939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:44.034070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 755/1490] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:44.034070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.034070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:44.044619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b37ed-d333-45ac-90ef-cdb8087d49c8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.120592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.123014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.123014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.123014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.123014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.124740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.140911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 756/1491] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.141174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.153475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19de2773-afeb-4744-b002-ab29f321dd37 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.161063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.165503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.165818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8c12c-8b18-4078-937c-0e07ff832135 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.165925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.165925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.165925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.165925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.170218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.170965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.171287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.171627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.172384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.174200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.186267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 736/1492] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.187419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.198014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680d1bba-7c70-468a-84f5-c46cc305db04 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.203347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.203998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.204281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.204557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] PATH_INFO: `/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868/users/49479761be354627836a5b0b43dbbcc1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.221332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063c46bf8ca4c57b0bcb6a83a2ca868, user_id=49479761be354627836a5b0b43dbbcc1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.224065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.251586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 757/1493] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:44 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:44.252536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.297516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 737/1494] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:44 2022] PUT /identity/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868/users/49479761be354627836a5b0b43dbbcc1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:44.298838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.325263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d0aabe-65e8-439c-8e78-aeab8005e5da admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.406318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.407341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.407898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.408701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.409893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.411192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e44fd7-b6e8-4a3f-8ed3-146b2cfe888c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.412086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.418132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.418765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.419622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.419913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.420627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.423255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.427374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 758/1495] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.428315 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.447092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fe447-a724-4ae2-9e3e-ce03755a3119 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.454488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.455373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.455844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.456441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.457515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.464036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.475984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 759/1496] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.477068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.487881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b40a5-e9c2-4c18-9b95-7a892e6531b4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.498738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.498738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.498738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.498738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] PATH_INFO: `/v3/projects/71fa5f2c0a494efd9eb53a396bc36d7e/users/de17639444d14b8aa7134fda51a39cba/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.511992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71fa5f2c0a494efd9eb53a396bc36d7e, user_id=de17639444d14b8aa7134fda51a39cba, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.514959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce650c2d-3841-4b11-923d-1f86e957f83f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.528147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 738/1497] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:44 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:44.528147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.540470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ca21b-2cc1-4550-acea-897aaf427f87 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.553248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.554555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.554843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.555125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] PATH_INFO: `/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868/users/49479761be354627836a5b0b43dbbcc1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.559013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0063c46bf8ca4c57b0bcb6a83a2ca868, user_id=49479761be354627836a5b0b43dbbcc1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.562348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.575530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 739/1498] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:44 2022] PUT /identity/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868/users/49479761be354627836a5b0b43dbbcc1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:44.576397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.596592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 760/1499] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:44 2022] PUT /identity/v3/projects/71fa5f2c0a494efd9eb53a396bc36d7e/users/de17639444d14b8aa7134fda51a39cba/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:44.598600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6f28-8bc4-418d-b06f-61251a70565c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.599144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6f28-8bc4-418d-b06f-61251a70565c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.599763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd6f28-8bc4-418d-b06f-61251a70565c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.636427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4fbd6f28-8bc4-418d-b06f-61251a70565c None None] MFA Rules not processed for user `49479761be354627836a5b0b43dbbcc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:44.638539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4fbd6f28-8bc4-418d-b06f-61251a70565c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:44.677176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f2c09-98c7-4d05-b980-a047ed45bb7a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.750753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.751560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.751817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.752091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.753118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.754597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.767347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 740/1500] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.768914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 761/1501] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:44.771208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.772333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.772877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.773785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.788121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c093f-b37d-4c4e-a41b-dcdf1f8385de admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.793757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.794487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.794772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.795101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.795892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:44.798009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:44.815347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 741/1502] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:44.815975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] MFA Rules not processed for user `de17639444d14b8aa7134fda51a39cba`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:44.816240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:44.818337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:44.828579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:44.964323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335d73-8ceb-4fe3-8c88-d661a6e35ea5 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:44.968733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:44.970485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:44.974726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:44.985369 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:44.986590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 762/1503] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:44.987567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.001689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.003317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.010915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55f6b-7fb4-4c23-a5bc-f4320a9e3ac3 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.017961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 742/1504] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:45.018954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.020512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.024427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.026066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.026505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.026959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] PATH_INFO: `/v3/projects/8feeb9f184284dfa969ff2309c042b33/users/35cb276f97d446e58967953338c40679/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.036676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbc15f-d557-41d9-9d20-b5a89f303c56 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.044210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.046254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.046987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.047623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] PATH_INFO: `/v3/projects/a23a3cf765a543259dadcf718e64f94b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.048891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8feeb9f184284dfa969ff2309c042b33, user_id=35cb276f97d446e58967953338c40679, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.049713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] RBAC: Authorizing `identity:delete_project(project_id=a23a3cf765a543259dadcf718e64f94b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.052083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.053371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.165342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 763/1505] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:44 2022] PUT /identity/v3/projects/8feeb9f184284dfa969ff2309c042b33/users/35cb276f97d446e58967953338c40679/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:45.165342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.178360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:45.213962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a23a3cf765a543259dadcf718e64f94b', 'request_id': 'req-d0681dd2-868e-414c-b77a-670d809ff9df'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:45.225955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a23a3cf765a543259dadcf718e64f94b', 'request_id': 'req-d0681dd2-868e-414c-b77a-670d809ff9df'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:45.236244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a23a3cf765a543259dadcf718e64f94b', 'request_id': 'req-d0681dd2-868e-414c-b77a-670d809ff9df'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:45.273004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c6d7c-49ef-4594-b2e4-17db7433765a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.328506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] The token cache is being invalidate because project a23a3cf765a543259dadcf718e64f94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:45.329480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:45.330260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d0681dd2-868e-414c-b77a-670d809ff9df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:45.338792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 743/1506] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:45 2022] DELETE /identity/v3/projects/a23a3cf765a543259dadcf718e64f94b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:45.341860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f23a-bc33-45c7-bafb-40770835ca70 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.342235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f23a-bc33-45c7-bafb-40770835ca70 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.342603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267f23a-bc33-45c7-bafb-40770835ca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.378742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.383951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.383951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.383951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.383951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.384341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4267f23a-bc33-45c7-bafb-40770835ca70 None None] MFA Rules not processed for user `35cb276f97d446e58967953338c40679`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:45.384434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167ba39-8450-4f8d-9bd8-61195a2d0cba admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.384503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4267f23a-bc33-45c7-bafb-40770835ca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.502276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 744/1507] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:45.502276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.502276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.502276 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.524732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:45.526965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.541163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 745/1508] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:45.541163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.544556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 764/1509] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/projects => generated 371 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:45.544650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.547828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.547828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.547828 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.569161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:45.588007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:45.588255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b0fe9-dcd1-4334-83b2-aebce7b3c296 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.590142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.674539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 765/1510] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:45.675683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.677057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:45.695064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7fb145-eace-4b65-a195-18530bdf66b5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.708062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.709153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.709153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.709319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.709881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.712413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.723499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.724130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.724392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.724665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.725469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.728112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.829447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 766/1511] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:45.830536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.842991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9265c-7b64-44e4-99b7-dfe9804a793c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.847986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.849007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.849749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.853071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.853940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:45.854422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.862904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 746/1512] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:45 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:45.863651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:45.868445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:45.976669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ec10b-c552-4d56-afc7-9f9024a7c0fa admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:45.986401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:45.987378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:45.987880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:45.988400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:45.989414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:45.991712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.011996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 747/1513] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.013358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.036211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb19fec-11ce-4076-a8e7-40ba95640258 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.050840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.052110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.052748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.053099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.055079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.058314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.112961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 767/1514] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:46.113945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.130145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1543057c-e9b0-46f3-bd3d-877dad733b3e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.137114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.137874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.138161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.138438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] PATH_INFO: `/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99/users/8585763a4ffa42cc964ee3e9519ca162/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.157819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 748/1515] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:46 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:46.159200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.174878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b773d1e-276b-4845-af9a-aa7cff9420c6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.182213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.182384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f8a13d71b4bcd86fe62f96790cb99, user_id=8585763a4ffa42cc964ee3e9519ca162, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.188114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.188114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.188114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.188514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.192202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.195492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.284666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 768/1516] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:46 2022] PUT /identity/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99/users/8585763a4ffa42cc964ee3e9519ca162/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:46.286333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.312555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 749/1517] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:46 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:46.312555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.392982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc84a5e-37ed-4635-97e0-02b860e63ee1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.429964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7567c1-deb7-4316-b323-e3ed343ad591 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.436196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.436892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.437199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.437474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.438575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.440337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.451384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 750/1518] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.452175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.463171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f86d9-7c1f-48f1-ac11-6336e5d9cca8 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.465888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.466575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.466925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.467287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.467997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.468081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.468652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.468936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.469280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.469945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.470042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.471978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c800ea74-6c4f-4c6e-8740-058733b0020a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.480057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 769/1519] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.480829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.490704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20bdf6-629c-48e1-8737-f4c1ea5983b5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.495964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.496601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.496881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.497204 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] PATH_INFO: `/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99/users/8585763a4ffa42cc964ee3e9519ca162/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.499115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e51f8a13d71b4bcd86fe62f96790cb99, user_id=8585763a4ffa42cc964ee3e9519ca162, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.501779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.513139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 770/1520] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:46 2022] PUT /identity/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99/users/8585763a4ffa42cc964ee3e9519ca162/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:46.514365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.576780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:46.579625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66622bdf-b200-443b-b896-aa5e03ec8c3f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.598232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.598958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.599238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.599516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] PATH_INFO: `/v3/projects/49e141eb3f424696a37991298b96d67e/users/5d0c066be2544a34a166cd6b64761049/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.608527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 751/1521] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:46 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:46.610934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.611434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.611807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.624921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e141eb3f424696a37991298b96d67e, user_id=5d0c066be2544a34a166cd6b64761049, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.628100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.657015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] MFA Rules not processed for user `8585763a4ffa42cc964ee3e9519ca162`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:46.659662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:46.731433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 771/1522] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:46 2022] PUT /identity/v3/projects/49e141eb3f424696a37991298b96d67e/users/5d0c066be2544a34a166cd6b64761049/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:46.732212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.733617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 752/1523] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:46.735550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.754735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee5646b-9f74-4c63-a95e-f147bc637d01 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.828985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c5c67-ace4-478f-9376-9ab8bcd84fd3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.830398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.831026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.831311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.831590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.832757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.834285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.834499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.835054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.835357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.835632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.836279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.837897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.847417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 753/1524] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.848254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.849202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 772/1525] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.853373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.853618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:46.855934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:46.867530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c566d1-f963-45c6-a7d3-d977f7a8dd24 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.872380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.873094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.873366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.873642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] PATH_INFO: `/v3/projects/49e141eb3f424696a37991298b96d67e/users/5d0c066be2544a34a166cd6b64761049/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.875599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49e141eb3f424696a37991298b96d67e, user_id=5d0c066be2544a34a166cd6b64761049, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.878569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.900799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 773/1526] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:46 2022] PUT /identity/v3/projects/49e141eb3f424696a37991298b96d67e/users/5d0c066be2544a34a166cd6b64761049/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:46.900799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:46.916001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf251ec-a127-416e-b2e4-775773f827bb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.969772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ec05b-dd18-4eaa-9c52-9d280fbaa89e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:46.970636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.971414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.971631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.971930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.974608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:46.975249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.975529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.975806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:46.976996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:46.978633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe54c2-4ff5-4e73-a0bd-2009aea7f144 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:46.988840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 774/1527] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:46.988840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:46.988840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:46.988840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.025445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] MFA Rules not processed for user `5d0c066be2544a34a166cd6b64761049`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:47.026848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:47.072278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.072278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.080212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 754/1528] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:47.082003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.097758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1c847-a386-4711-94db-2768a1c83e7f service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.106719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.108660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.109926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.109926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] PATH_INFO: `/v3/projects/4e380f5ed8764ad0b07b02bf6c858b1e/users/46dca3bde2724f41b0968262edba550e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.136889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e380f5ed8764ad0b07b02bf6c858b1e, user_id=46dca3bde2724f41b0968262edba550e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.139881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975c3d7-e63a-4014-b401-e7a935e6e773 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.166542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 775/1529] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:47.207623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.226803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 755/1530] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:47 2022] PUT /identity/v3/projects/4e380f5ed8764ad0b07b02bf6c858b1e/users/46dca3bde2724f41b0968262edba550e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:47.237958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.238468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.238897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.240776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241662-f921-45e8-a701-f4e5b082abd0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.307452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] MFA Rules not processed for user `46dca3bde2724f41b0968262edba550e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:47.309473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:47.379163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.379895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.380201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.380485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.468184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 756/1531] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:47.472680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.539585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.544021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.579474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 776/1532] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:47.591042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.594954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31409f13-b599-4b43-94fa-245a8ac3ed64 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.596077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:47.603800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.604056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.604327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.604611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.607673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.612497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.619951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1587e2-b575-421c-bbf4-ab17790a1e2e service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.629647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.630280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.630655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.630889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.635080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:47.737802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.743297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.761825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 757/1533] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:47 2022] POST /identity/v3/projects => generated 375 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:47.762911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.778704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 777/1534] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:47.781001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:47.806359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7bdbcd-52b6-42a0-a94f-65b8301724a9 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.897195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d376e83c-f0f5-4e17-a341-e77e9762d4b5 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:47.900546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.901187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.901468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.901777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.902360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.902469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:47.903103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:47.903457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:47.903850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] PATH_INFO: `/v3/users/35cb276f97d446e58967953338c40679` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:47.904286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:47.905196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cb276f97d446e58967953338c40679)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:47.907306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.008644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 778/1535] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:47 2022] POST /identity/v3/users => generated 294 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:48.009850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.021319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359f94d-b0d8-4fc3-abdc-ab5ae7fde9ac admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.026887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.027669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.028424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.028424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.028876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:48.030612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.044723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 779/1536] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:48.045803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.056017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76f3d-8330-4679-96aa-ced3fc242268 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.061891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.062901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.063199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.063790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] PATH_INFO: `/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9/users/b23ff362ba61439fb93dcacca87b21b2/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.082535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b05ee3f8ed47b998f75ca0fd835be9, user_id=b23ff362ba61439fb93dcacca87b21b2, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:48.086091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.121703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cb276f97d446e58967953338c40679'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:48.135549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cb276f97d446e58967953338c40679'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:48.135549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cb276f97d446e58967953338c40679'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:48.199451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 780/1537] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:48 2022] PUT /identity/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9/users/b23ff362ba61439fb93dcacca87b21b2/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:48.203548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.205437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:48.239765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cb276f97d446e58967953338c40679'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:48.261577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d6bd52e1-8cb7-4d8a-bbe2-a98403b6931f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cb276f97d446e58967953338c40679'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:48.279964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 758/1538] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:47 2022] DELETE /identity/v3/users/35cb276f97d446e58967953338c40679 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:48.281964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.282389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.282690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.298059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eababb1a-a55c-440b-90d0-2bc6337534a6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.304624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:48.307032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:48.411365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.412069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.412355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.412635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.413657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:48.415509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.422098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 759/1539] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:48.426256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 781/1540] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:48.430473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.441900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e210964-58e9-4f49-a977-34f6630e7eb4 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.443531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.445951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:48.448096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.448923 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.449288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.449572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] PATH_INFO: `/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9/users/b23ff362ba61439fb93dcacca87b21b2/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.451870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b05ee3f8ed47b998f75ca0fd835be9, user_id=b23ff362ba61439fb93dcacca87b21b2, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:48.454859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71ce4-7bc7-4926-9c7b-dfb3b9671911 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.484405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 760/1541] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:48 2022] PUT /identity/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9/users/b23ff362ba61439fb93dcacca87b21b2/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:48.488000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.488855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.489338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.581992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:48.586608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccdb27f-0a58-4ccb-aaea-0e39022e1cfb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.607388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] MFA Rules not processed for user `b23ff362ba61439fb93dcacca87b21b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:48.608810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:48.702188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.703490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.703776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.704052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.744823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 761/1542] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:48.769788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:48.776045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:48.857492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:48.859047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:48.872956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 782/1543] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:48.908084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c59733-e824-49cb-9a9a-5ad7f27d7724 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:48.913435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:48.914070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:48.914399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:48.914681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:48.917510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.022380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:49.023891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:49.039763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:49.049337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 762/1544] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:49.145262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:49.146650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.164960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e225b-7146-4f0c-bcc4-f9a0175eefd2 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:49.171214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:49.171868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:49.172157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:49.172431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] PATH_INFO: `/v3/users/91e14965b0214eab90b6e897cbb0acbe` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:49.174202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91e14965b0214eab90b6e897cbb0acbe)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:49.176888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:49.392175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91e14965b0214eab90b6e897cbb0acbe'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.404349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91e14965b0214eab90b6e897cbb0acbe'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.418845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91e14965b0214eab90b6e897cbb0acbe'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.419691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91e14965b0214eab90b6e897cbb0acbe'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.444359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:49.446527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.463462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942be59-1f4c-49f6-be0b-e568b779bed7 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:49.469883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:49.470717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:49.471090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:49.471488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] PATH_INFO: `/v3/projects/8feeb9f184284dfa969ff2309c042b33` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:49.472847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8feeb9f184284dfa969ff2309c042b33)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:49.474999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:49.502379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f73512ed-8917-463d-96b9-a1a6ef4b157a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91e14965b0214eab90b6e897cbb0acbe'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.510522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 783/1545] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:49 2022] DELETE /identity/v3/users/91e14965b0214eab90b6e897cbb0acbe => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:49.515069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:49.515529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:49.515938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:49.539411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:49.539780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.612050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 784/1546] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:49.620668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8feeb9f184284dfa969ff2309c042b33', 'request_id': 'req-03c6000c-e627-4e50-ada5-a565993928e9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.621676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:49.623543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.629487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8feeb9f184284dfa969ff2309c042b33', 'request_id': 'req-03c6000c-e627-4e50-ada5-a565993928e9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.638030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8feeb9f184284dfa969ff2309c042b33', 'request_id': 'req-03c6000c-e627-4e50-ada5-a565993928e9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.687876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49b42-359d-4169-bb34-0f95aa7c3d17 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:49.730499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] The token cache is being invalidate because project 8feeb9f184284dfa969ff2309c042b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:49.731930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.734743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:49.741009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 763/1547] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:49 2022] DELETE /identity/v3/projects/8feeb9f184284dfa969ff2309c042b33 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:49.742154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:49.744171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.766219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:49.767370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:49.767842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:49.768443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:49.770848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:49.823406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6000c-e627-4e50-ada5-a565993928e9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:49.823406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:49.823406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:49.823406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:49.823862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] PATH_INFO: `/v3/users/5d0c066be2544a34a166cd6b64761049` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:49.823984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0c066be2544a34a166cd6b64761049)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:49.826255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:49.871770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:49.873274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a355b-72f1-45f9-b120-4794b3b2cb81 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:49.886329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 785/1548] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:50.043382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0c066be2544a34a166cd6b64761049'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.055416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0c066be2544a34a166cd6b64761049'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.056071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0c066be2544a34a166cd6b64761049'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.146517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0539-27d3-485f-b789-70de9bc22ca3 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:50.147355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0539-27d3-485f-b789-70de9bc22ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:50.147563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0539-27d3-485f-b789-70de9bc22ca3 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:50.150203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 786/1549] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:41:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 12 12:41:50.181191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0c066be2544a34a166cd6b64761049'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.181399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:50.181691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:50.182029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:50.216190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:50.217532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:50.228883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0c066be2544a34a166cd6b64761049'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.247452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 764/1550] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:49 2022] DELETE /identity/v3/users/5d0c066be2544a34a166cd6b64761049 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:50.361927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:50.436703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 787/1551] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:41:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:50.511648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:50.513222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:50.586632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:50.588274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:50.597619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197524b-ce00-4ac9-926c-d86cad19ae96 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:50.606706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:50.609994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:50.609994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:50.609994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:50.621209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:50.623341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:50.639454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafde2f8-0760-4f39-9c63-88d8137bffeb None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:50.654524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 765/1552] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:50.725036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:50.726638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:50.727179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:50.727660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] PATH_INFO: `/v3/projects/40614bc7b1c04a4080a2ce6f4cd8962d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:50.729666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=40614bc7b1c04a4080a2ce6f4cd8962d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:50.732165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:50.868837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40614bc7b1c04a4080a2ce6f4cd8962d', 'request_id': 'req-ffd25161-37a4-4602-b7d5-cbdac2f92dab'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.889412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40614bc7b1c04a4080a2ce6f4cd8962d', 'request_id': 'req-ffd25161-37a4-4602-b7d5-cbdac2f92dab'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:50.955077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40614bc7b1c04a4080a2ce6f4cd8962d', 'request_id': 'req-ffd25161-37a4-4602-b7d5-cbdac2f92dab'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.001555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] The token cache is being invalidate because project 40614bc7b1c04a4080a2ce6f4cd8962d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:51.001866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.002759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.017977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 788/1553] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:50 2022] DELETE /identity/v3/projects/40614bc7b1c04a4080a2ce6f4cd8962d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:51.018155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:51.029877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519073-5298-4ec7-adbe-c84d4aea9799 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:51.094159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:51.094947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.095227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.095509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] PATH_INFO: `/v3/users/49479761be354627836a5b0b43dbbcc1` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.096693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49479761be354627836a5b0b43dbbcc1)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:51.098793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:51.377606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49479761be354627836a5b0b43dbbcc1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.390480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:51.391457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:51.416555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49479761be354627836a5b0b43dbbcc1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.423372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd25161-37a4-4602-b7d5-cbdac2f92dab admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:51.424801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49479761be354627836a5b0b43dbbcc1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.433209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:51.434159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.434615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.435066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] PATH_INFO: `/v3/projects/49e141eb3f424696a37991298b96d67e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.436712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49e141eb3f424696a37991298b96d67e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:51.438860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:51.502184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49479761be354627836a5b0b43dbbcc1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.522346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-43748e31-e672-47b0-a277-24f4db77ce16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49479761be354627836a5b0b43dbbcc1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.532336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 766/1554] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:51 2022] DELETE /identity/v3/users/49479761be354627836a5b0b43dbbcc1 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:51.598960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49e141eb3f424696a37991298b96d67e', 'request_id': 'req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.611380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49e141eb3f424696a37991298b96d67e', 'request_id': 'req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.750196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49e141eb3f424696a37991298b96d67e', 'request_id': 'req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.766128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] The token cache is being invalidate because project 49e141eb3f424696a37991298b96d67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:51.766413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.767270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5435a73b-4569-4bd0-97e9-f6da36f7b4b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:51.768991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 789/1555] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:51 2022] DELETE /identity/v3/projects/49e141eb3f424696a37991298b96d67e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:51.774782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.775064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.775342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.798764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:51.800011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:51.877897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 767/1556] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:51.879392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.879691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.879974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.901280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:51.902523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:51.919571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 790/1557] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:51.923478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:51.935023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3c08e-d734-4cf9-8765-0adc7ba3b5c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:51.939589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:51.940285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.940663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.941011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.941803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:51.942195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:51.943898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:51.957946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 768/1558] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:41:51.962220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:51.971541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035f6b9-ed6e-40f8-96b4-173529d67452 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:51.977187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:51.977813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:51.978096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:51.978385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:51.979478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:51.982255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.082650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 791/1559] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:51 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:52.087088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.098444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38776b2b-63a4-4716-a5d0-83d4cf0cf88a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.142793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.144591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.206662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.207362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.207816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.208097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.209314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.211458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.260925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff294d-15cd-480a-a485-5df678ff6245 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.265861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.266494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.266777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.267047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] PATH_INFO: `/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.268237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0063c46bf8ca4c57b0bcb6a83a2ca868)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.270196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.341098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 769/1560] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:52.345083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.355145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a3161-feae-4766-a89b-f6a75d3f7d11 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.360123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.360718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.361003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.362018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.362018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.363658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.377024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 770/1561] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:52.377209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0063c46bf8ca4c57b0bcb6a83a2ca868', 'request_id': 'req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:52.378078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.382820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0063c46bf8ca4c57b0bcb6a83a2ca868', 'request_id': 'req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:52.385722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:52.389435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe33c-5e10-4779-a937-c917e29a4f53 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.445972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.446513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.446794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.447068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.447706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.449356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.459179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 771/1562] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:52.463780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.467554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0063c46bf8ca4c57b0bcb6a83a2ca868', 'request_id': 'req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:52.474685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c5935-31e1-4a56-bafe-17d21593adee admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.479510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] The token cache is being invalidate because project 0063c46bf8ca4c57b0bcb6a83a2ca868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:52.479889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.480004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:52.480538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.480671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d27cc6e4-8aa4-4a7f-adee-7ce18c9d5b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:52.480813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.481085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] PATH_INFO: `/v3/projects/fba866d140d249d189a86e827b6d4b96/users/0d4b13f54ea54dd691520caa71f4f027/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.482212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 792/1563] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:52 2022] DELETE /identity/v3/projects/0063c46bf8ca4c57b0bcb6a83a2ca868 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:52.487042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa5b9-c17a-49f0-ba56-bcb71294ac89 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.487323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa5b9-c17a-49f0-ba56-bcb71294ac89 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.487597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fa5b9-c17a-49f0-ba56-bcb71294ac89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.496015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba866d140d249d189a86e827b6d4b96, user_id=0d4b13f54ea54dd691520caa71f4f027, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.498701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.508110 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ae4fa5b9-c17a-49f0-ba56-bcb71294ac89 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:52.509380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ae4fa5b9-c17a-49f0-ba56-bcb71294ac89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.517697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 793/1564] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:52.526032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.526319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.526592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.545973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:52.547176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.555100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 794/1565] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:52.559540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.568151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad08c4-14c2-40ec-858d-2c23d1dbd302 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.572960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.573583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.573864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.574130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.574766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:41:52.575063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.576977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.589773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 795/1566] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:41:52.594264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.599548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 772/1567] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:52 2022] PUT /identity/v3/projects/fba866d140d249d189a86e827b6d4b96/users/0d4b13f54ea54dd691520caa71f4f027/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:52.603976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.604959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5fb3e-f6ae-4ee3-99e3-031219460819 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.605968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.663314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.664588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.664693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a077-6a0b-4f08-b655-40a7973e7375 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.664869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.665164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.665871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.667971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066d7bc-d96f-4082-8770-7c60a4a2a53b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.668507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.669107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.669415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.669684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.671386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.708022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:52.742400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 796/1568] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/projects => generated 399 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:52.742481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.742481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.746359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.746641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.746916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.752264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 773/1569] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:52.765496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.781550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f915eb-357b-46b0-a679-a6cd0b6c51f4 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.790788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] MFA Rules not processed for user `0d4b13f54ea54dd691520caa71f4f027`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:52.794539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.860879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.861700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.861983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.862358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.863475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.868840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.891155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 797/1570] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:52.901357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.903386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:52.921911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bf26ab-df67-4492-aa46-cf4801b3b853 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:52.930138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:52.930989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:52.931346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:52.931692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:52.932536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:52.934809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:52.957186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 774/1571] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/users => generated 300 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:52.959435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:52.992476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678f753-987d-4359-b64c-0f7cad5e3cb9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.008722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.009428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.010115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.010115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.010696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.012296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.025116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 775/1572] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:53.029288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.039456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96713a25-5781-49d0-87e5-f08b0da82fdc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.046097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.046920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.057445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.057445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.057445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.057445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.068341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 776/1573] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:53.075436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.089006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e54a-3b6c-44c7-8c57-f94b0b3e64c1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.089238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 798/1574] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:52 2022] POST /identity/v3/projects => generated 381 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:53.092019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.187729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.188417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.188792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.188956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] PATH_INFO: `/v3/projects/229bf763cf2142baa458ba7bc96fac0c/users/c7c904d0c265405d9c4b80280f865516/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.190991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808702f6-7e3e-4c1f-b17b-dd4094c27dc7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.206257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.206947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.207360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.207571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.208215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.211855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4685f54-71d0-4ed7-a7eb-32bcb51e9a92 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.226996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=229bf763cf2142baa458ba7bc96fac0c, user_id=c7c904d0c265405d9c4b80280f865516, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.226996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.304640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 777/1575] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:53 2022] PUT /identity/v3/projects/229bf763cf2142baa458ba7bc96fac0c/users/c7c904d0c265405d9c4b80280f865516/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:53.315843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 799/1576] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:53 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:41:53.321625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.321931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.322214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.322589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.440903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] MFA Rules not processed for user `c7c904d0c265405d9c4b80280f865516`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:53.442198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:53.529151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a55e75-eeb7-4959-9a4c-1fc76b0589ba admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.535892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.536522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.536817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.537068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.538038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.539703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.581833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 778/1577] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:53.586103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.589424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 800/1578] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:53.597941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2783c-529f-472a-a3fd-17d8ae6d1f16 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.599260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.603563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.604264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.604546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.604823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] PATH_INFO: `/v3/projects/d7851da77c7141b78462ac34171b526f/users/90806bf070ce4fda81d1648bba277240/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.612472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c64d61-8935-4233-b2b3-0fe5ada3c70e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.620238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.620861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.620965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7851da77c7141b78462ac34171b526f, user_id=90806bf070ce4fda81d1648bba277240, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.621161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.621443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.622314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.623638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.624421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.799334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 779/1579] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:53 2022] PUT /identity/v3/projects/d7851da77c7141b78462ac34171b526f/users/90806bf070ce4fda81d1648bba277240/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:53.803293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.820441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 801/1580] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:41:53 2022] POST /identity/v3/projects => generated 401 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:53.821472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.864666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82388a2-6330-4109-9309-16f63526dd75 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.889553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a2b84d-14d5-419c-9a10-74e5b84f33f6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.894617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.895230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.895644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.895921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.896558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.898546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.929110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.930337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.930613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.930881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.931516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.933296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.942926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 780/1581] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:53.946951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:53.956527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341905b-0c40-4151-9271-e41ed4986a97 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:53.962819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:53.964321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.964321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.964321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] PATH_INFO: `/v3/projects/d7851da77c7141b78462ac34171b526f/users/90806bf070ce4fda81d1648bba277240/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:53.966295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7851da77c7141b78462ac34171b526f, user_id=90806bf070ce4fda81d1648bba277240, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:53.969020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156cc47-3c3c-495d-8007-77a1131ddacd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:53.982836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 781/1582] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:53 2022] PUT /identity/v3/projects/d7851da77c7141b78462ac34171b526f/users/90806bf070ce4fda81d1648bba277240/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:53.994404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:53.994699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:53.995002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.024099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] MFA Rules not processed for user `90806bf070ce4fda81d1648bba277240`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:54.025375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:54.051758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 802/1583] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:41:53 2022] POST /identity/v3/users => generated 307 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:41:54.056810 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.083852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f9e58-0bda-4711-8645-4797c908a114 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.123948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 782/1584] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:41:54.139123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.203959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.204607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.205251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.205628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.206669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.208450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.225835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 803/1585] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:41:54.227727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.234833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5faf88a-0445-4dbe-98cf-3e1af0e93de1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.239973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1242f-9cd8-403a-87d6-0a338998f6c8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.245954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.255894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.255894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.255894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.256181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.256181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.256181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.256181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] PATH_INFO: `/v3/projects/4128f3890186429f8b07e2afda3065b9/users/1b625113f2b94e19b8ef35f6256b9157/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.262314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.264015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.275834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 783/1586] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:54.284606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4128f3890186429f8b07e2afda3065b9, user_id=1b625113f2b94e19b8ef35f6256b9157, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.286872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.389061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 804/1587] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:54 2022] PUT /identity/v3/projects/4128f3890186429f8b07e2afda3065b9/users/1b625113f2b94e19b8ef35f6256b9157/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:54.396516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.408061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.412023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05119d69-4f70-47b2-a69c-093aab35da73 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.467547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d79c7-0bc4-4edc-b607-5566a8fefd82 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.471202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.471872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.472149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.472416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.482592 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.483304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.483581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.483855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.484522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.486152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.496183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 784/1588] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:41:54.500594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.510918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a564a5a-fc43-4648-b8dc-be7a40e2b605 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.515640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.516280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.516562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.516832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] PATH_INFO: `/v3/projects/4128f3890186429f8b07e2afda3065b9/users/1b625113f2b94e19b8ef35f6256b9157/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.518774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4128f3890186429f8b07e2afda3065b9, user_id=1b625113f2b94e19b8ef35f6256b9157, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.521450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc9c8d-7d25-46d5-8e86-3fd7ec2752f8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.529790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.531329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.532613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 785/1589] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:41:54 2022] PUT /identity/v3/projects/4128f3890186429f8b07e2afda3065b9/users/1b625113f2b94e19b8ef35f6256b9157/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:41:54.545958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.550166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.550166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.550483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 805/1590] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:41:54.584745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] MFA Rules not processed for user `1b625113f2b94e19b8ef35f6256b9157`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:54.586653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:54.693164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 786/1591] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:54 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:54.701416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:54.894876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:54.894876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:54.905193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d524e-3225-414a-bd5d-05ba8b8c6e74 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:54.957491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:54.958112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:54.958387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:54.958656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:54.968018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:54.969566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:54.980348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 806/1592] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:54 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:54.999505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:55.476990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:55.496855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b2313-ed98-4d8e-bc6f-9fca57616526 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:55.511529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:55.511529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:55.511529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:55.511914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:55.654425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:55.655887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398b3b1-c7b9-49a0-9486-770b52e87f60 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:55.679979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 787/1593] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:55 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:56.628365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:57.096938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:57.970264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:58.101821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec56c99-eefb-4a50-b25c-057f50a9a3a3 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:58.126161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:58.126875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:58.127162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:58.127436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] PATH_INFO: `/v3/users/0d4b13f54ea54dd691520caa71f4f027` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:58.130945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d4b13f54ea54dd691520caa71f4f027)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:58.133769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:58.249964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:58.404737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d4b13f54ea54dd691520caa71f4f027'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:58.416639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d4b13f54ea54dd691520caa71f4f027'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:58.436371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d4b13f54ea54dd691520caa71f4f027'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:58.437243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d4b13f54ea54dd691520caa71f4f027'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:58.540670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d4b13f54ea54dd691520caa71f4f027'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:58.548732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 807/1594] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:57 2022] DELETE /identity/v3/users/0d4b13f54ea54dd691520caa71f4f027 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:58.553929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:58.553929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:58.554859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:58.578750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:41:58.580328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:58.659682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 788/1595] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:41:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:41:58.685506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:58.687055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:58.764462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a630ed-37bf-4f15-a9af-a2196b56649c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:58.768401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:58.769029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:58.769354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:58.769857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:58.779325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:58.780799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:58.791634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 808/1596] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:41:58.953855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:59.541329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:59.610908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:59.612425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:41:59.628331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4bc62f-5847-4e68-86ff-2e8d01ee0093 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:41:59.647709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:41:59.655085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:41:59.655534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:41:59.655847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] PATH_INFO: `/v3/projects/fba866d140d249d189a86e827b6d4b96` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:41:59.665558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba866d140d249d189a86e827b6d4b96)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:41:59.667453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:41:59.790086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba866d140d249d189a86e827b6d4b96', 'request_id': 'req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:59.796197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba866d140d249d189a86e827b6d4b96', 'request_id': 'req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:59.803398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba866d140d249d189a86e827b6d4b96', 'request_id': 'req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:59.856416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:59.918920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] The token cache is being invalidate because project fba866d140d249d189a86e827b6d4b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:41:59.919197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:59.919815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:41:59.921337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 789/1597] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:41:59 2022] DELETE /identity/v3/projects/fba866d140d249d189a86e827b6d4b96 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:41:59.925200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:41:59.937541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90ae4-b1f5-4d1e-9a20-97c8f23fdd08 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:00.001458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:00.002121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:00.002485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:00.002904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] PATH_INFO: `/v3/users/90806bf070ce4fda81d1648bba277240` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:00.004242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90806bf070ce4fda81d1648bba277240)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:00.006305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:00.234244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90806bf070ce4fda81d1648bba277240'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:00.241312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90806bf070ce4fda81d1648bba277240'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:00.253825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90806bf070ce4fda81d1648bba277240'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:00.254510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90806bf070ce4fda81d1648bba277240'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:00.357721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-29cd5d82-5eaa-42ca-9f03-60bcc126b8a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90806bf070ce4fda81d1648bba277240'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:00.364442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 809/1598] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:41:59 2022] DELETE /identity/v3/users/90806bf070ce4fda81d1648bba277240 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:00.615309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:00.826964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:00.828601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:00.844441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248aed-8a26-43fc-b0c9-395c9c4f1f08 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:00.906828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:00.907409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:00.907783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:00.907958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] PATH_INFO: `/v3/projects/d7851da77c7141b78462ac34171b526f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:00.909166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7851da77c7141b78462ac34171b526f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:00.911108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:00.966851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:01.076711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7851da77c7141b78462ac34171b526f', 'request_id': 'req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.082366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7851da77c7141b78462ac34171b526f', 'request_id': 'req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.093360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7851da77c7141b78462ac34171b526f', 'request_id': 'req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.181869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] The token cache is being invalidate because project d7851da77c7141b78462ac34171b526f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:01.182124 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.182937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.184489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 790/1599] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:00 2022] DELETE /identity/v3/projects/d7851da77c7141b78462ac34171b526f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:01.189515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837169-cc18-477b-8c1b-66b39fb11164 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.189880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837169-cc18-477b-8c1b-66b39fb11164 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.190359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8837169-cc18-477b-8c1b-66b39fb11164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.212958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f8837169-cc18-477b-8c1b-66b39fb11164 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:01.214307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f8837169-cc18-477b-8c1b-66b39fb11164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.258357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.259884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.288471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 810/1600] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:01.290099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.290391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.290665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.311895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:01.313139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.323613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 811/1601] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:01.328163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.338919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26add-de5b-4108-915b-7772b7171c7b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.344042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39cf4f-a6f4-40c3-8a60-f1a0e87af55c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.344262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.344717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.344996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.345332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.345998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:01.346301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.348019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.349179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.349814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.350122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.350543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] PATH_INFO: `/v3/users/c7c904d0c265405d9c4b80280f865516` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.352270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c904d0c265405d9c4b80280f865516)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.354266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.363289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 812/1602] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:01.368254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.380051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaa0dd-40c0-4493-8389-9e811f18dbec admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.385050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.385747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.386088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.387447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.387447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.389031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.510621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 813/1603] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:01 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:01.511734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.578685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c904d0c265405d9c4b80280f865516'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.597784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c904d0c265405d9c4b80280f865516'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.598578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c904d0c265405d9c4b80280f865516'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.608219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be8133-81b2-4a20-8b77-0ff074c2d99a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.613608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.614716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.614716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.614920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.615601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.617799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.735063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c904d0c265405d9c4b80280f865516'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.775128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 814/1604] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:01 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:01.776901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.778792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.780615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-65810fe1-149c-4524-9d1c-fbe9f6d9e3dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c904d0c265405d9c4b80280f865516'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:01.792611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 791/1605] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:01 2022] DELETE /identity/v3/users/c7c904d0c265405d9c4b80280f865516 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:01.799120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.799488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.799778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.800107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86810f39-3d09-4890-9898-85da03d7b9bc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.826241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:01.827593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.888063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.889852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.890202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.890546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.891267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.893671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.908994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 815/1606] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:01.918700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 792/1607] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:01.923683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.932251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.934544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:01.946871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6baa37-7b4e-4f9c-9083-4c20721de16c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:01.956015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:01.956568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:01.956853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:01.957157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:01.959649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:01.961719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:01.977330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 816/1608] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:01.980368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:01.996154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459295b0-5ba0-472a-bb69-3ad34b72fcef admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:02.001324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:02.002198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:02.002579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:02.002941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] PATH_INFO: `/v3/projects/0d52269518a248b9b9bd873cc50c554e/users/6f5f87fbf2c54574ba623be6a8764183/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:02.014428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f037f1b-b74f-4ee2-9367-72eb23fb7f34 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:02.018702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:02.023822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:02.023822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:02.023822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:02.024081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d52269518a248b9b9bd873cc50c554e, user_id=6f5f87fbf2c54574ba623be6a8764183, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:02.025316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:02.033917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:02.035693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0f3b6-929b-4af4-9824-9cd300456aa5 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:02.047373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 793/1609] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:02.113980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 817/1610] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:01 2022] PUT /identity/v3/projects/0d52269518a248b9b9bd873cc50c554e/users/6f5f87fbf2c54574ba623be6a8764183/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:02.125838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:02.126123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:02.126394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:02.157291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] MFA Rules not processed for user `6f5f87fbf2c54574ba623be6a8764183`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:02.158533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:02.239722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 794/1611] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:02.381353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:02.383738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:02.444322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2c34c-a2c5-4ded-bef7-4cafc782fc06 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:02.449332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:02.449993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:02.450274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:02.450806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:02.461371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:02.462835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:02.478449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:02.478943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 818/1612] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:42:02.867937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:02.933248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:02.935299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:03.039170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87f6e3-24d2-41ee-a8e7-44a8ea6c9979 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:03.044176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:03.044826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:03.045105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:03.045435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] PATH_INFO: `/v3/projects/229bf763cf2142baa458ba7bc96fac0c` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:03.046587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=229bf763cf2142baa458ba7bc96fac0c)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:03.048532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:03.079777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:03.155649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '229bf763cf2142baa458ba7bc96fac0c', 'request_id': 'req-fefcb464-ca3d-41cb-b787-54723a32b8e4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.163715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '229bf763cf2142baa458ba7bc96fac0c', 'request_id': 'req-fefcb464-ca3d-41cb-b787-54723a32b8e4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.170956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '229bf763cf2142baa458ba7bc96fac0c', 'request_id': 'req-fefcb464-ca3d-41cb-b787-54723a32b8e4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.267832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] The token cache is being invalidate because project 229bf763cf2142baa458ba7bc96fac0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:03.268056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.268692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.270487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 795/1613] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:02 2022] DELETE /identity/v3/projects/229bf763cf2142baa458ba7bc96fac0c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:03.274489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:03.285564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368cf2a-2c12-48e1-8bc4-60db1ba15c55 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:03.377990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:03.378730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:03.379163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:03.380030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] PATH_INFO: `/v3/users/1b625113f2b94e19b8ef35f6256b9157` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:03.380807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b625113f2b94e19b8ef35f6256b9157)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:03.383124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:03.796148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b625113f2b94e19b8ef35f6256b9157'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.798527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b625113f2b94e19b8ef35f6256b9157'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.815557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b625113f2b94e19b8ef35f6256b9157'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.816524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b625113f2b94e19b8ef35f6256b9157'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.895157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45c0a48b-bf42-4e3c-a02f-a36fb738a26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b625113f2b94e19b8ef35f6256b9157'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:03.905453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 819/1614] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:03 2022] DELETE /identity/v3/users/1b625113f2b94e19b8ef35f6256b9157 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:04.274328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:04.327434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:04.329019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:04.343267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefcb464-ca3d-41cb-b787-54723a32b8e4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:04.414907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:04.415579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:04.415863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:04.416144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] PATH_INFO: `/v3/projects/4128f3890186429f8b07e2afda3065b9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:04.417594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4128f3890186429f8b07e2afda3065b9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:04.419741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:04.563313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4128f3890186429f8b07e2afda3065b9', 'request_id': 'req-54580a99-3123-49f8-9d97-c92d5ce4dae2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:04.568851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4128f3890186429f8b07e2afda3065b9', 'request_id': 'req-54580a99-3123-49f8-9d97-c92d5ce4dae2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:04.582308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4128f3890186429f8b07e2afda3065b9', 'request_id': 'req-54580a99-3123-49f8-9d97-c92d5ce4dae2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:04.719876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] The token cache is being invalidate because project 4128f3890186429f8b07e2afda3065b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:04.720244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:04.720845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-54580a99-3123-49f8-9d97-c92d5ce4dae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:04.722680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 796/1615] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:04 2022] DELETE /identity/v3/projects/4128f3890186429f8b07e2afda3065b9 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:04.727755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:04.728291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:04.728456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:04.750379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:04.751614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:04.815180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 820/1616] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:04.823591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:04.823941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:04.824289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:04.844327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:04.845595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:04.854415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 797/1617] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:04.858884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:04.869450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611fc1b-43c1-42e6-a602-fce23f1e004a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:04.874300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:04.874911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:04.875199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:04.875473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:04.876764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:04.877075 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:04.878725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:04.890763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 821/1618] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:04.895375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:04.905976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c3c04-934b-4255-9fac-dfbf0cc7e0c6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:04.911399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:04.912162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:04.912603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:04.912887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:04.913581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:04.916104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.031108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 798/1619] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:04 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:05.035031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.047848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950794c-206c-4d27-943d-a7b1ba2b8170 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.112366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.112981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.113302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.113577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.114222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.116143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.126347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:05.227639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 822/1620] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:05 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:05.234546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.244716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b07cd-3e63-44e7-91b7-ac81a847c9db admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.261089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.261089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.261089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.261089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.261475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.262836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.277017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 799/1621] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:05.277878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.288592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f851e5f-1406-4111-b5b4-d9bf2c23a859 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.296225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.296741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.297026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.297338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.297995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.299610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6adb00-c56b-4888-b399-b5b9f21b3d9f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.314094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 823/1622] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:05.318505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.334873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76defbd9-ad35-476b-b829-118105465c0e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.340292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.341153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.341495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.341778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] PATH_INFO: `/v3/projects/8168a249c869456b900d4258b9114bf4/users/cd4ba22112f241e58babac65e7b5781f/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.358983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8168a249c869456b900d4258b9114bf4, user_id=cd4ba22112f241e58babac65e7b5781f, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.362104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.469009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 800/1623] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:05 2022] PUT /identity/v3/projects/8168a249c869456b900d4258b9114bf4/users/cd4ba22112f241e58babac65e7b5781f/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:05.483348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.483676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.483949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.512520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] MFA Rules not processed for user `cd4ba22112f241e58babac65e7b5781f`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:05.513778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:05.586676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 824/1624] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:05 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:05.591388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.653650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f15fb-92c0-40b0-975b-d6896bf2b417 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.659913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.663941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.663941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.663941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.663941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.665877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.762739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 801/1625] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:05 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:05.766151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.778241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20e44e-1e1c-43b0-ab0f-3a716a424cb5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.834372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.835099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.835387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.835759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.837052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.839019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:05.978311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 825/1626] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:05 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:05.979765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:05.990078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb55d6d-df7c-4d48-825f-7cf3a0de4e0c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:05.995899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:05.996527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:05.996810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:05.997118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:05.997890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:05.999457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:06.011273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 802/1627] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:06.015528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:06.025694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbf2c4-6a6c-4600-a8bb-199bcef051bf admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:06.030277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:06.038050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.038050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.038050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] PATH_INFO: `/v3/projects/00f9eb1804574722b0a7a80b60e10adc/users/248243c49dc7495c8e19b9e37281ba73/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.046354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f9eb1804574722b0a7a80b60e10adc, user_id=248243c49dc7495c8e19b9e37281ba73, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:06.049002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:06.125689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 826/1628] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:06 2022] PUT /identity/v3/projects/00f9eb1804574722b0a7a80b60e10adc/users/248243c49dc7495c8e19b9e37281ba73/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:06.132601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:06.143116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d7dd-fa70-41b7-a7be-db8f128096e4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:06.199325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:06.199942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.200226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.200502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.201452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:06.203047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f84da7-d04c-4911-97b7-614380b6d314 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:06.213044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 803/1629] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:06.217341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:06.229008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab84fbd-3c95-4ad0-a83b-d372ac7a65e5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:06.233690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:06.234346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.234644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.238944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] PATH_INFO: `/v3/projects/00f9eb1804574722b0a7a80b60e10adc/users/248243c49dc7495c8e19b9e37281ba73/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.238944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f9eb1804574722b0a7a80b60e10adc, user_id=248243c49dc7495c8e19b9e37281ba73, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:06.239555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:06.250208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 827/1630] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:06 2022] PUT /identity/v3/projects/00f9eb1804574722b0a7a80b60e10adc/users/248243c49dc7495c8e19b9e37281ba73/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:06.261013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.270056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.270056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.288910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] MFA Rules not processed for user `248243c49dc7495c8e19b9e37281ba73`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:06.290182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:06.359253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 804/1631] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:06 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:06.370505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:06.372162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:06.382556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:06.430635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4262e5-6726-4017-973c-ae0cf8a45ee5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:06.434359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:06.434964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.435246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.435519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.444595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:06.446078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95047931-76ba-43b2-abb0-7c3478a5c3ff service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:06.456049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 828/1632] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:06 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:06.705790 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:06.792706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d40f7-d516-4e7d-8942-660dccc15e32 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:06.798454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:06.799086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:06.799366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:06.799638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] PATH_INFO: `/v3/users/cd4ba22112f241e58babac65e7b5781f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:06.800765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd4ba22112f241e58babac65e7b5781f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:06.803131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:07.013273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd4ba22112f241e58babac65e7b5781f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.020422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd4ba22112f241e58babac65e7b5781f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.021189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd4ba22112f241e58babac65e7b5781f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.091530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd4ba22112f241e58babac65e7b5781f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.106002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd4ba22112f241e58babac65e7b5781f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.112374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 805/1633] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:06 2022] DELETE /identity/v3/users/cd4ba22112f241e58babac65e7b5781f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:07.116663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:07.117866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:07.117866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:07.137859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:07.139090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:07.188922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:07.206711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 829/1634] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:07.216794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:07.218360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:07.280384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a30891-3984-41e0-bb88-4b43bdec7ede admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:07.284343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:07.284984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:07.285304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:07.285579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:07.295116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:07.299240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:07.306611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 806/1635] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:07.740410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:07.742199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:07.755088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7ce6f-a23d-4846-ac0c-578d306505a1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:07.762503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:07.763432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:07.763761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:07.764090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] PATH_INFO: `/v3/projects/8168a249c869456b900d4258b9114bf4` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:07.766048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] RBAC: Authorizing `identity:delete_project(project_id=8168a249c869456b900d4258b9114bf4)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:07.770083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:07.904178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8168a249c869456b900d4258b9114bf4', 'request_id': 'req-f9270ca5-53f3-4fc3-a672-cab2b574efda'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:07.910871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8168a249c869456b900d4258b9114bf4', 'request_id': 'req-f9270ca5-53f3-4fc3-a672-cab2b574efda'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.004740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8168a249c869456b900d4258b9114bf4', 'request_id': 'req-f9270ca5-53f3-4fc3-a672-cab2b574efda'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.016209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] The token cache is being invalidate because project 8168a249c869456b900d4258b9114bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:08.016498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.017144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.018650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 830/1636] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:07 2022] DELETE /identity/v3/projects/8168a249c869456b900d4258b9114bf4 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:08.022620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:08.037511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ddc34-53ed-452c-9cbd-cdc465bf52cb service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:08.044168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:08.104628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:08.105322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:08.105603 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:08.105880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] PATH_INFO: `/v3/users/248243c49dc7495c8e19b9e37281ba73` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:08.107020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=248243c49dc7495c8e19b9e37281ba73)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:08.108948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:08.268645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:08.345158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '248243c49dc7495c8e19b9e37281ba73'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.352749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '248243c49dc7495c8e19b9e37281ba73'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.353486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '248243c49dc7495c8e19b9e37281ba73'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.434130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '248243c49dc7495c8e19b9e37281ba73'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.447841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a8bccca3-4f27-484f-bd2f-4e080d38e1c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '248243c49dc7495c8e19b9e37281ba73'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:08.454073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 807/1637] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:08 2022] DELETE /identity/v3/users/248243c49dc7495c8e19b9e37281ba73 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:08.878121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:08.879587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:08.897874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9270ca5-53f3-4fc3-a672-cab2b574efda admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:08.968514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:08.969231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:08.969548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:08.969788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] PATH_INFO: `/v3/projects/00f9eb1804574722b0a7a80b60e10adc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:08.970908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f9eb1804574722b0a7a80b60e10adc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:08.972821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.082586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f9eb1804574722b0a7a80b60e10adc', 'request_id': 'req-5b35de26-6aef-4381-bd74-68dc1fa3eae2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:09.090169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f9eb1804574722b0a7a80b60e10adc', 'request_id': 'req-5b35de26-6aef-4381-bd74-68dc1fa3eae2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:09.228108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f9eb1804574722b0a7a80b60e10adc', 'request_id': 'req-5b35de26-6aef-4381-bd74-68dc1fa3eae2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:09.239827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] The token cache is being invalidate because project 00f9eb1804574722b0a7a80b60e10adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:09.240125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:09.240784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b35de26-6aef-4381-bd74-68dc1fa3eae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:09.242877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 831/1638] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:08 2022] DELETE /identity/v3/projects/00f9eb1804574722b0a7a80b60e10adc => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:09.248133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.248418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.248694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.274376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:09.275659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:09.340309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 808/1639] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:09.348538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.349053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.349281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.371538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:09.373293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:09.381147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 832/1640] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:09.386586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.397236 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538f805-c4e6-4c6b-86e3-336e641cfcc8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.402005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.402614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.402892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.403162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.403812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:09.404117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.405784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.418682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 809/1641] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:09.423177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.433823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732313c-45fc-4af0-aa0e-204365e5865a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.438642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.439254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.439535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.439806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.440445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.442506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.472708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:09.525454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 833/1642] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:09 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:09.529810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.540436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be94c77d-4f28-48ca-850f-e404c0311e23 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.599440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.599974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.600271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.600548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.601314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.604294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.748848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 810/1643] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:09 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:09.752802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.762919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082da641-a51d-4f18-ac7e-f0964b32000c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.767510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.768125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.768393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.768669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.769656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.771118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.781400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 834/1644] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:09.787751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.801435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d5465-f24a-4508-81ba-ffe57faea034 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.806843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.807727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.808193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.808949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.809640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.813405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677fc64a-9641-4270-b8a9-ac01bda2e28a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.825349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 811/1645] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:09.829781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:09.836716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:09.843260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce472a-2646-4cfd-ad85-75fd403f0778 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:09.848214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:09.848894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.849201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.855074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] PATH_INFO: `/v3/projects/f45fd78edcc34ebe96d045a4a21e641f/users/ad530f4dffb14aeb82425382e3597617/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.866132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f45fd78edcc34ebe96d045a4a21e641f, user_id=ad530f4dffb14aeb82425382e3597617, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:09.869271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:09.931808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 835/1646] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:09 2022] PUT /identity/v3/projects/f45fd78edcc34ebe96d045a4a21e641f/users/ad530f4dffb14aeb82425382e3597617/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:09.943879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:09.944171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:09.944454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:09.975265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] MFA Rules not processed for user `ad530f4dffb14aeb82425382e3597617`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:09.977317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:10.047881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 812/1647] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:10.052409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.109605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:10.122835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9680d-d8e0-492d-b9d2-51c0a82b303a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.128087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.128724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.129008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.129316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.129967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.131924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.261016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 836/1648] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:10 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:10.262586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.274614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6cc3b-30de-43dd-ba63-35525a3c037a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.345733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.346724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.346966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.347238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.347880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.349865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.435359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 813/1649] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:10 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:10.439644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.451059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d867e-2d47-47dc-bf36-1cee07c9a728 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.456047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.465373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.465373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.465373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.465373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.465373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.472509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 837/1650] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:10.477486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.488221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59220fa-9d83-4a5c-bc91-369ee435bb3d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.493967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.494764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.495053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.495330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] PATH_INFO: `/v3/projects/92877d35efbd4e03b03e92d35f37e41e/users/5fe59100b6534a32a3b21cd022bd7a05/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.515563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92877d35efbd4e03b03e92d35f37e41e, user_id=5fe59100b6534a32a3b21cd022bd7a05, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.520149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.640043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.640449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 814/1651] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:10 2022] PUT /identity/v3/projects/92877d35efbd4e03b03e92d35f37e41e/users/5fe59100b6534a32a3b21cd022bd7a05/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:10.650381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982601f-4ae3-4bdb-bb07-691d316f2bfb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.723444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.729222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.729222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.729222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.729222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.729222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7df8-2c94-4de4-b35c-e94c90a5eb3b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.743605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 838/1652] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:10.744947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.756485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de42250-5b69-4455-80e8-cede25334b5b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.762234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.763622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.764045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.764616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] PATH_INFO: `/v3/projects/92877d35efbd4e03b03e92d35f37e41e/users/5fe59100b6534a32a3b21cd022bd7a05/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.767662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92877d35efbd4e03b03e92d35f37e41e, user_id=5fe59100b6534a32a3b21cd022bd7a05, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:10.771197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:10.795176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 815/1653] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:10 2022] PUT /identity/v3/projects/92877d35efbd4e03b03e92d35f37e41e/users/5fe59100b6534a32a3b21cd022bd7a05/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:10.805861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.806160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.806427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:10.837977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] MFA Rules not processed for user `5fe59100b6534a32a3b21cd022bd7a05`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:10.839474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:10.917330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 839/1654] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:10.926598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:10.928510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:10.987280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57029b3-fd2b-46ac-abc3-a3c2c0057ef0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:10.990847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:10.991448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:10.991723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:10.991993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:11.001300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:11.002872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:11.012162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 816/1655] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:11.114498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:11.439452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:11.440934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:11.506625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b3b81-8844-4762-911a-3c01c7f3b094 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:11.512727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:11.513575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:11.514073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:11.514548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] PATH_INFO: `/v3/users/46dca3bde2724f41b0968262edba550e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:11.515792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] RBAC: Authorizing `identity:delete_user(user_id=46dca3bde2724f41b0968262edba550e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:11.517764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:11.554053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:11.569398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba851aa3-49ef-425c-a087-fc48c0d4f730 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:11.575264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:11.576422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:11.576752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:11.577073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] PATH_INFO: `/v3/users/ad530f4dffb14aeb82425382e3597617` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:11.578417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad530f4dffb14aeb82425382e3597617)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:11.580882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:11.802642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46dca3bde2724f41b0968262edba550e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.825198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46dca3bde2724f41b0968262edba550e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.838907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46dca3bde2724f41b0968262edba550e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.839646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46dca3bde2724f41b0968262edba550e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.862454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad530f4dffb14aeb82425382e3597617'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.871364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad530f4dffb14aeb82425382e3597617'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.872138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad530f4dffb14aeb82425382e3597617'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.925430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5c10785f-2ec9-4a35-a4af-f64c6c34088a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46dca3bde2724f41b0968262edba550e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:11.933780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 840/1656] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:11 2022] DELETE /identity/v3/users/46dca3bde2724f41b0968262edba550e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:11.937804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:11.938089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:11.938824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:11.961978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:11.963175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:12.015140 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad530f4dffb14aeb82425382e3597617'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:12.032162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0fc6cf0a-fee2-47a1-99ac-b962188e6fbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad530f4dffb14aeb82425382e3597617'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:12.040857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 841/1657] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:12.041999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:12.052741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:12.054309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 817/1658] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:11 2022] DELETE /identity/v3/users/ad530f4dffb14aeb82425382e3597617 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:12.059512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:12.059794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:12.061475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:12.071397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:12.092788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:12.094061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:12.168259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9211ead2-317c-4952-bcf3-41274b06c96d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:12.221335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 818/1659] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:12.231408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:12.231930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:12.232247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:12.232738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:12.233087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:12.244714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:12.245083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c634d9-2265-4e2d-927b-387f46dd2a1e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:12.246328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:12.249063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:12.249870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:12.250299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:12.250715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:12.260688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 842/1660] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:42:12.262850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:12.264322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:12.275972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 819/1661] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:12.279877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:13.241680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:13.242800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:13.244071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:13.245083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:13.263643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8622b0a5-95c8-4b4c-aea2-5b1a25bfc64b service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:13.271303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:13.279767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:13.279767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:13.279767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] PATH_INFO: `/v3/projects/f45fd78edcc34ebe96d045a4a21e641f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:13.279767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f45fd78edcc34ebe96d045a4a21e641f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:13.279767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:13.285707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aeda88-2d35-4eb9-b8a1-8ec1685e59bd service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:13.292540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:13.293424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:13.293549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:13.293786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] PATH_INFO: `/v3/projects/4e380f5ed8764ad0b07b02bf6c858b1e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:13.295018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e380f5ed8764ad0b07b02bf6c858b1e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:13.297106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:13.445329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f45fd78edcc34ebe96d045a4a21e641f', 'request_id': 'req-7b6657c9-cd04-40ec-b986-29dc9b45c651'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.451015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f45fd78edcc34ebe96d045a4a21e641f', 'request_id': 'req-7b6657c9-cd04-40ec-b986-29dc9b45c651'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.458128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f45fd78edcc34ebe96d045a4a21e641f', 'request_id': 'req-7b6657c9-cd04-40ec-b986-29dc9b45c651'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.476842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e380f5ed8764ad0b07b02bf6c858b1e', 'request_id': 'req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.483826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e380f5ed8764ad0b07b02bf6c858b1e', 'request_id': 'req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.542938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] The token cache is being invalidate because project f45fd78edcc34ebe96d045a4a21e641f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:13.543271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.543962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.545690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 820/1662] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:13 2022] DELETE /identity/v3/projects/f45fd78edcc34ebe96d045a4a21e641f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:13.549488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:13.550804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:13.614796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6657c9-cd04-40ec-b986-29dc9b45c651 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:13.656693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e380f5ed8764ad0b07b02bf6c858b1e', 'request_id': 'req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.669246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] The token cache is being invalidate because project 4e380f5ed8764ad0b07b02bf6c858b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:13.669394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.670183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.671789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 843/1663] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:13 2022] DELETE /identity/v3/projects/4e380f5ed8764ad0b07b02bf6c858b1e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:13.674038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:13.674800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:13.675070 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:13.675346 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] PATH_INFO: `/v3/users/5fe59100b6534a32a3b21cd022bd7a05` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:13.675937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:13.676502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe59100b6534a32a3b21cd022bd7a05)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:13.677444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:13.678525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:13.690325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7e6e5-60ee-40fd-91ce-2fda6552f7f3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:13.694967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:13.695646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:13.695929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:13.696211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] PATH_INFO: `/v3/users/b23ff362ba61439fb93dcacca87b21b2` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:13.697402 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23ff362ba61439fb93dcacca87b21b2)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:13.699329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:13.838589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe59100b6534a32a3b21cd022bd7a05'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.845873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe59100b6534a32a3b21cd022bd7a05'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.846664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe59100b6534a32a3b21cd022bd7a05'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.927728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23ff362ba61439fb93dcacca87b21b2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.934931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23ff362ba61439fb93dcacca87b21b2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.943632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:13.944526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe59100b6534a32a3b21cd022bd7a05'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.948081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23ff362ba61439fb93dcacca87b21b2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.954463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23ff362ba61439fb93dcacca87b21b2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.960330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe59100b6534a32a3b21cd022bd7a05'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:13.967067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 821/1664] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:13 2022] DELETE /identity/v3/users/5fe59100b6534a32a3b21cd022bd7a05 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:14.095073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23ff362ba61439fb93dcacca87b21b2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.102967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 844/1665] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:13 2022] DELETE /identity/v3/users/b23ff362ba61439fb93dcacca87b21b2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:14.318826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:14.521731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:14.523190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:14.620495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f78b6-9825-417a-9dcb-685f6ea42222 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:14.687739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:14.688308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:14.688599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:14.688909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] PATH_INFO: `/v3/projects/92877d35efbd4e03b03e92d35f37e41e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:14.690290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92877d35efbd4e03b03e92d35f37e41e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:14.692304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:14.759847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:14.762678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:14.782271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955e688-ca95-4351-855f-723a91009841 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:14.802458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:14.803590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:14.804582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:14.805060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] PATH_INFO: `/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:14.807641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b05ee3f8ed47b998f75ca0fd835be9)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:14.815513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:14.845101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92877d35efbd4e03b03e92d35f37e41e', 'request_id': 'req-4be0436c-9481-4d3d-918f-d92b01f1200c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.853941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92877d35efbd4e03b03e92d35f37e41e', 'request_id': 'req-4be0436c-9481-4d3d-918f-d92b01f1200c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.861252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92877d35efbd4e03b03e92d35f37e41e', 'request_id': 'req-4be0436c-9481-4d3d-918f-d92b01f1200c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.945975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b05ee3f8ed47b998f75ca0fd835be9', 'request_id': 'req-e132d589-a256-4cf8-9e8d-244fffd71528'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.956129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b05ee3f8ed47b998f75ca0fd835be9', 'request_id': 'req-e132d589-a256-4cf8-9e8d-244fffd71528'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.964106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] The token cache is being invalidate because project 92877d35efbd4e03b03e92d35f37e41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:14.965847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.965847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-4be0436c-9481-4d3d-918f-d92b01f1200c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:14.977002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:14.980026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 822/1666] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:14 2022] DELETE /identity/v3/projects/92877d35efbd4e03b03e92d35f37e41e => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:14.985093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1765-8e0c-4535-9e8b-8992e1880c7f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:14.988614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1765-8e0c-4535-9e8b-8992e1880c7f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:14.988614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1765-8e0c-4535-9e8b-8992e1880c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.011924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-30af1765-8e0c-4535-9e8b-8992e1880c7f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.013244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-30af1765-8e0c-4535-9e8b-8992e1880c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.022665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b05ee3f8ed47b998f75ca0fd835be9', 'request_id': 'req-e132d589-a256-4cf8-9e8d-244fffd71528'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:15.041157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] The token cache is being invalidate because project d5b05ee3f8ed47b998f75ca0fd835be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:15.041621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:15.042456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e132d589-a256-4cf8-9e8d-244fffd71528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:15.044615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 845/1667] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:14 2022] DELETE /identity/v3/projects/d5b05ee3f8ed47b998f75ca0fd835be9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:15.049876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20314d5-8695-4681-9a34-2c770b9fb787 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.051038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20314d5-8695-4681-9a34-2c770b9fb787 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.051038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20314d5-8695-4681-9a34-2c770b9fb787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.091806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 823/1668] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:15.107602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.108028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.108311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.126230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c20314d5-8695-4681-9a34-2c770b9fb787 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.133442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c20314d5-8695-4681-9a34-2c770b9fb787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.147339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.148717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.152936 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 846/1669] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:15.161617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.162418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.162877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.169411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 824/1670] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:15.182766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.189320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.190624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.193591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd953fb7-79f2-4a3e-8cf6-c5a8d441c932 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.198528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.199610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.199610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.199793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.200743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:15.201670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.203462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 847/1671] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:15.204248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.214501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.214685 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b05920-d7d2-46a2-bd14-37bf45709468 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.220026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.220762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.221470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.221748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.222405 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:15.222709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.224330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.234473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 825/1672] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:15.241619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.246334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 848/1673] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:15.250921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.253810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10fa63d-5376-4b64-a330-cb4ce2dc50d6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.259908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.260676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.262395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.262761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.263807 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.263991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da8350-60da-4e2f-b29e-fc4189d316bc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.266431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.271350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.272220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.272683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.273154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.274169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.277097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.292139 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:15.414677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 826/1674] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:15.418756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 849/1675] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:15.419291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.423571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.489882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb7ab4-49a3-4a99-bcd1-fcce2c50e18f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.491880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ea09e-58a6-4972-95cd-f4ce2df1c88d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.494797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.495594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.495874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.496149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.496904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.497034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.497578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.497856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.498140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.498921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.499058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.500883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.586300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 827/1676] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:15.588143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.597922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff030348-fba8-4aa0-8859-1f0fb08d28ca admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.603674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.604490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.604681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.605162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.605829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.606304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 850/1677] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:15.610281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.610828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.622376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d27cf4-c5e4-4eac-ad4e-ec998bb7cfee admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.625795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 828/1678] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:15.626832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.628072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.628755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.629104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.629476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.630202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.631923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.637805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39731211-2158-446f-9e75-d46958f5971a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.642796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.646384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 851/1679] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:15.652095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.652095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.652095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.652095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.652095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.652696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.659922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 829/1680] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:15.663643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562de73-5aa0-4d09-a612-14946d9198b8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.664103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.670084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.670084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.670084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.670450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.671099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.672887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.675132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25448f2c-c4c8-4122-a6a3-6909c43488dc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.682162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.686563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.686563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.686563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] PATH_INFO: `/v3/projects/960223e1b2f14fb3a4595b039446bb6a/users/b0f7d7bb5a714be98146d475530b6d98/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.686812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 852/1681] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:15.691050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:15.701927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960223e1b2f14fb3a4595b039446bb6a, user_id=b0f7d7bb5a714be98146d475530b6d98, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.703743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1403c-02e9-444c-8cdd-2d7ec1bed86c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:15.705510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f412f8-acd7-49e0-bc51-2d99aaecaae6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.708610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:15.709393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.709671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.710045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] PATH_INFO: `/v3/projects/f376aea87afd4fa5b8b7af5cc0a0540e/users/0e7eb7bbd3b54686bb019197dd74a50a/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.726785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f376aea87afd4fa5b8b7af5cc0a0540e, user_id=0e7eb7bbd3b54686bb019197dd74a50a, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:15.729392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20637b0a-de53-429a-8696-a998ed60b8fc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:15.823445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 830/1682] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:15 2022] PUT /identity/v3/projects/960223e1b2f14fb3a4595b039446bb6a/users/b0f7d7bb5a714be98146d475530b6d98/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:15.833680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.833966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.834246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.861445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] MFA Rules not processed for user `b0f7d7bb5a714be98146d475530b6d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.867373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.867498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 853/1683] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:15 2022] PUT /identity/v3/projects/f376aea87afd4fa5b8b7af5cc0a0540e/users/0e7eb7bbd3b54686bb019197dd74a50a/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:15.875974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:15.876258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:15.876529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:15.919403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] MFA Rules not processed for user `0e7eb7bbd3b54686bb019197dd74a50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:15.920812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:15.953305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 831/1684] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:15.958340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.023605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 854/1685] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:16.029922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.052486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01bcdb-9067-400a-8872-757c92cc6bf6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.059574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.060266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.060553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.060832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.061781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.063913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.109736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3308e-8fca-4991-af89-9c2513739472 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.116386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.117099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.117319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.117595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.118925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.120976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.151600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 832/1686] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:15 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:16.155611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.233297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a107b-cc96-433f-bb24-62278182b906 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.246251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.258838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 855/1687] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:16 2022] POST /identity/v3/projects => generated 381 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:16.261271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.263966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.264486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.265533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.266373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.268434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.376753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 833/1688] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:16 2022] POST /identity/v3/users => generated 297 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:16.381230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.386113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3bb0-10ba-409e-88a9-2ff690cc86b5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.391686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7493e25d-a7c7-4fb9-879e-51fd34752ccc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.392372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.393341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.393877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.394639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.395616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.396593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.397228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.397507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.397779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.398425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.400121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.400246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.410969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 834/1689] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:16.416611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.429973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f513104-6998-44be-ac19-c0055e56b6d4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.436074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.439584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.439584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.439584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] PATH_INFO: `/v3/projects/a4bc99ac363641b989b526302047b112/users/6f263c7713f04bd7b9cc71eaa7489ba8/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.454220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bc99ac363641b989b526302047b112, user_id=6f263c7713f04bd7b9cc71eaa7489ba8, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.457452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.521304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 856/1690] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:16 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:16.529327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.546129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a334b76-7b1d-4a6b-8a76-79c12c10aa0f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.568338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.569317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.569600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.573242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.573242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.573242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.575039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 835/1691] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:16 2022] PUT /identity/v3/projects/a4bc99ac363641b989b526302047b112/users/6f263c7713f04bd7b9cc71eaa7489ba8/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:16.580479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.595396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:16.606466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 857/1692] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:16.617675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.631060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aa9ea-8a99-4acd-b237-68733d78225b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.706470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf3fbde-29b0-44aa-b873-19eaa1cddf22 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.724169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.724812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.725097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.735019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.735019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.735019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.748538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 836/1693] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:16.749487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.764089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054e789-0eff-4de3-bcfe-0a1842a97da6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.765417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.766104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.766389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.766675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] PATH_INFO: `/v3/projects/15a784715e90449689d161f5783dede3/users/08df35477a404a278dbee7a2b6cedf8f/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.795211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:16.796051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.800255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.800650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] PATH_INFO: `/v3/projects/a4bc99ac363641b989b526302047b112/users/6f263c7713f04bd7b9cc71eaa7489ba8/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.803348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4bc99ac363641b989b526302047b112, user_id=6f263c7713f04bd7b9cc71eaa7489ba8, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.806630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a784715e90449689d161f5783dede3, user_id=08df35477a404a278dbee7a2b6cedf8f, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:16.809401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.812529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d54ec-0faa-4c46-88db-44a7305d5c76 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:16.828296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 837/1694] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:16 2022] PUT /identity/v3/projects/a4bc99ac363641b989b526302047b112/users/6f263c7713f04bd7b9cc71eaa7489ba8/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:16.840949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:16.841270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:16.841555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:16.881693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] MFA Rules not processed for user `6f263c7713f04bd7b9cc71eaa7489ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:16.883730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:16.906951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 858/1695] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:16 2022] PUT /identity/v3/projects/15a784715e90449689d161f5783dede3/users/08df35477a404a278dbee7a2b6cedf8f/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:16.910741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:16.989216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 838/1696] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:16.989440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3aa538-2680-40e4-8614-dc4b97f1f93c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:16.993983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:17.003184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:17.003184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:17.003849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:17.004831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.005538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.005971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.006665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:17.008349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:17.026135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 859/1697] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:17.029341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:17.051437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9b1adc-7954-43bb-97bb-2dd97e1d56d5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:17.056997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:17.061191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.061191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.061191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] PATH_INFO: `/v3/projects/15a784715e90449689d161f5783dede3/users/08df35477a404a278dbee7a2b6cedf8f/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.062352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a784715e90449689d161f5783dede3, user_id=08df35477a404a278dbee7a2b6cedf8f, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:17.067283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013d8df8-7e9b-4c3f-ba1f-b1216f1dd4f6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:17.086880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 860/1698] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:17 2022] PUT /identity/v3/projects/15a784715e90449689d161f5783dede3/users/08df35477a404a278dbee7a2b6cedf8f/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:17.095568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d33c1d1-177f-4d52-a1e9-35159322917c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:17.104595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.104899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.106697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.175436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] MFA Rules not processed for user `08df35477a404a278dbee7a2b6cedf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:17.176714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:17.181112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:17.181112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.181112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.181112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.281310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 861/1699] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:17.330681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:17.334520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:17.338329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:17.340074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:17.349820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce25d2-5d6e-4d6e-8379-89ec4a96e30f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:17.354786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:17.356854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.357363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.357799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.364048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 839/1700] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:17.374076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:17.376242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:17.389762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 862/1701] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:17.636128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:17.646330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34362f-7594-4a21-9122-70f7db8170e9 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:17.654343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:17.655193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:17.655304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:17.655504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:17.729927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:17.729927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:17.738354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 840/1702] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:17.800078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:17.892846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:18.455764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:18.837998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:18.992383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9eec5-4fd6-4c7a-b46b-5f5befd7c2ed service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:18.998854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.000196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.001317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.001916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] PATH_INFO: `/v3/users/b0f7d7bb5a714be98146d475530b6d98` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.004637 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f7d7bb5a714be98146d475530b6d98)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.007605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.074009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.085227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e88ebf-9e9b-4306-b65a-90077e984e49 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.090659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08df35477a404a278dbee7a2b6cedf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a784715e90449689d161f5783dede3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.091274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.091743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.092024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.092682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:19.092989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.094705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.111056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 841/1703] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:19.112368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.123616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36626e79-3b61-4293-946f-14501ad7f2ae tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.128687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08df35477a404a278dbee7a2b6cedf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a784715e90449689d161f5783dede3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.134676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.134676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.134676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.134676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.134676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.255650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 842/1704] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:19 2022] POST /identity/v3/projects => generated 353 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:19.260395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.269438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f7d7bb5a714be98146d475530b6d98'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.280264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f7d7bb5a714be98146d475530b6d98'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.297296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f7d7bb5a714be98146d475530b6d98'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.298169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f7d7bb5a714be98146d475530b6d98'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.346570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9f756-4da8-433f-ad62-946b0e70bbb5 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.351677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08df35477a404a278dbee7a2b6cedf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a784715e90449689d161f5783dede3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.352297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.352583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.352921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.353641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:19.353956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.355577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.365439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a9bc1d12-eb35-4c1b-9df9-b8fc338fabf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f7d7bb5a714be98146d475530b6d98'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.367771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 843/1705] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:19.368925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.372586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.384723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 863/1706] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:18 2022] DELETE /identity/v3/users/b0f7d7bb5a714be98146d475530b6d98 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:19.389220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.389509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.389782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.418445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:19.420873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.456349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06ffad8-6a5e-4b95-a6c5-5d859b86ff64 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.492906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 864/1707] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:19.498132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.500154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.523248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.524555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.524844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.525220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] PATH_INFO: `/v3/users/4eac367fb11f47c8b78ef739a63cc4d9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.526588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eac367fb11f47c8b78ef739a63cc4d9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.529046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.558917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:19.584577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432f6f08-cb06-4ace-8d26-916cf7f4c4c8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.589641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08df35477a404a278dbee7a2b6cedf8f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15a784715e90449689d161f5783dede3', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.590285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.590571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.590848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] PATH_INFO: `/v3/projects/c443feea9d194c66b7ab4c122c0f0de7` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.591977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c443feea9d194c66b7ab4c122c0f0de7)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.593930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.703691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c443feea9d194c66b7ab4c122c0f0de7', 'request_id': 'req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.703975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eac367fb11f47c8b78ef739a63cc4d9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.710303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c443feea9d194c66b7ab4c122c0f0de7', 'request_id': 'req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.710950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eac367fb11f47c8b78ef739a63cc4d9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.711640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eac367fb11f47c8b78ef739a63cc4d9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.786592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c443feea9d194c66b7ab4c122c0f0de7', 'request_id': 'req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.797644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] The token cache is being invalidate because project c443feea9d194c66b7ab4c122c0f0de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:19.797940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.798599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.800122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 865/1708] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:19 2022] DELETE /identity/v3/projects/c443feea9d194c66b7ab4c122c0f0de7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:19.800899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.802255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.838423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eac367fb11f47c8b78ef739a63cc4d9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.852237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eac367fb11f47c8b78ef739a63cc4d9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:19.859785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 844/1709] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:19 2022] DELETE /identity/v3/users/4eac367fb11f47c8b78ef739a63cc4d9 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:19.860293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:19.861648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.863891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb59894-d33f-4e3a-a8fc-ec2fcf84dee4 tempest-VolumeQuotaClassesTest-2018305762 tempest-VolumeQuotaClassesTest-2018305762-project-admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.921157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.921960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.922342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.922717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.925080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:19.941668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838025c5-0b09-4db5-b1d4-5fe070d83f83 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:19.946642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:19.947294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:19.951433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:19.951433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] PATH_INFO: `/v3/users/6f5f87fbf2c54574ba623be6a8764183` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:19.951433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5f87fbf2c54574ba623be6a8764183)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:19.951981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:19.999713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.001238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.014851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 866/1710] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:20.070292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:20.171878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.173303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.200821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf852a6-5a59-4688-9ec2-5671fb0ea728 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.206523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.207264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.208073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.208073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] PATH_INFO: `/v3/projects/a7ef55ce29924999b14a49b428ec8c70` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.209213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5f87fbf2c54574ba623be6a8764183'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.217786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ef55ce29924999b14a49b428ec8c70)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.220208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.220330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5f87fbf2c54574ba623be6a8764183'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.220960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5f87fbf2c54574ba623be6a8764183'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.326247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5f87fbf2c54574ba623be6a8764183'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.341615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2494e514-6450-436b-9b7d-33260c49fbd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5f87fbf2c54574ba623be6a8764183'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.347829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 845/1711] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:19 2022] DELETE /identity/v3/users/6f5f87fbf2c54574ba623be6a8764183 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:20.352260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.352595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.353431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.374152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:20.375181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ef55ce29924999b14a49b428ec8c70', 'request_id': 'req-eae66693-b713-44e4-be5f-04bc5d00349a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.375438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.383670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ef55ce29924999b14a49b428ec8c70', 'request_id': 'req-eae66693-b713-44e4-be5f-04bc5d00349a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.437038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 846/1712] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:20.450314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.454170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.480270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ef55ce29924999b14a49b428ec8c70', 'request_id': 'req-eae66693-b713-44e4-be5f-04bc5d00349a'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.498795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] The token cache is being invalidate because project a7ef55ce29924999b14a49b428ec8c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:20.499391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.500431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.503003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 867/1713] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:20 2022] DELETE /identity/v3/projects/a7ef55ce29924999b14a49b428ec8c70 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:20.504136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.519041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.534508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3990f2-6104-4566-8dba-4a6c5d9c9ab9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.538297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae66693-b713-44e4-be5f-04bc5d00349a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.541990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.541990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.541990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.541990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.543326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.543733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.544369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.544649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.544924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] PATH_INFO: `/v3/projects/960223e1b2f14fb3a4595b039446bb6a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.546075 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960223e1b2f14fb3a4595b039446bb6a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.548141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.559870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.565030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaec402-2ffe-4649-9fa7-0679fe06f84f service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.573044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 847/1714] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:20.574360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5264b4-3b9d-4de9-a92d-b7a52f5d86df None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.574611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5264b4-3b9d-4de9-a92d-b7a52f5d86df None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.574893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5264b4-3b9d-4de9-a92d-b7a52f5d86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.595343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-da5264b4-3b9d-4de9-a92d-b7a52f5d86df None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:20.596585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-da5264b4-3b9d-4de9-a92d-b7a52f5d86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.611153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 848/1715] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:20.616430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.617318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.617570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.638039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:20.639296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.647525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 849/1716] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:20.648558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.650582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.662561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ea268-a216-4e10-88f2-574137db0c2c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.667200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.667844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.668121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.668389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] PATH_INFO: `/v3/users/0e7eb7bbd3b54686bb019197dd74a50a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.669552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e7eb7bbd3b54686bb019197dd74a50a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.671502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.709242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960223e1b2f14fb3a4595b039446bb6a', 'request_id': 'req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.717290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960223e1b2f14fb3a4595b039446bb6a', 'request_id': 'req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.794984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960223e1b2f14fb3a4595b039446bb6a', 'request_id': 'req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.820854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] The token cache is being invalidate because project 960223e1b2f14fb3a4595b039446bb6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:20.820854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.822186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.828191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 868/1717] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:20 2022] DELETE /identity/v3/projects/960223e1b2f14fb3a4595b039446bb6a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:20.829097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.830601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.905858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68cac1-fdef-4c80-b4e8-4d1aecad51b0 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.908745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e7eb7bbd3b54686bb019197dd74a50a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.910659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.911305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.911585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.911854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.912652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:20.912773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.914412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:20.917791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e7eb7bbd3b54686bb019197dd74a50a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.919329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e7eb7bbd3b54686bb019197dd74a50a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:20.922535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:20.932982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 869/1718] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:20.934435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:20.937970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:20.951555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f535-b4fd-47eb-aaa3-e9f17606c68b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:20.956146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:20.958416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:20.958416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:20.958416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] PATH_INFO: `/v3/users/6f263c7713f04bd7b9cc71eaa7489ba8` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:20.958416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f263c7713f04bd7b9cc71eaa7489ba8)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:20.960313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.011527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e7eb7bbd3b54686bb019197dd74a50a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.024971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e7eb7bbd3b54686bb019197dd74a50a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.031400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 850/1719] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:20 2022] DELETE /identity/v3/users/0e7eb7bbd3b54686bb019197dd74a50a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:21.033589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.034944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.052002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:21.102706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e6e5-240d-4171-9774-aff2dd4e1f1a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.107296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.107901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.108181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.108454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.109083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.111015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.185244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f263c7713f04bd7b9cc71eaa7489ba8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.192354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f263c7713f04bd7b9cc71eaa7489ba8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.207161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 851/1720] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:21.207161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.207427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f263c7713f04bd7b9cc71eaa7489ba8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.207536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.207642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f263c7713f04bd7b9cc71eaa7489ba8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.277965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb228e9-8386-4204-a457-aaaad6b38076 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.278475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0cbf2446-d307-4860-bb5d-7e57cabee086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f263c7713f04bd7b9cc71eaa7489ba8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.278558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.278558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.278558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.278558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] PATH_INFO: `/v3/projects/0d52269518a248b9b9bd873cc50c554e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.278846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d52269518a248b9b9bd873cc50c554e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.279842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.281983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 870/1721] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:20 2022] DELETE /identity/v3/users/6f263c7713f04bd7b9cc71eaa7489ba8 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:21.283365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.283757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.284037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.305811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:21.308447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.376252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 871/1722] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:21.377282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.378565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.390689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccae00-0f9d-4552-8b29-78cafb1c54e8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.395837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.396450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.396729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.396993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.397672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.399739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.430364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d52269518a248b9b9bd873cc50c554e', 'request_id': 'req-dea25216-6dac-4b00-9ca2-b8c238196609'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.436823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d52269518a248b9b9bd873cc50c554e', 'request_id': 'req-dea25216-6dac-4b00-9ca2-b8c238196609'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.444197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d52269518a248b9b9bd873cc50c554e', 'request_id': 'req-dea25216-6dac-4b00-9ca2-b8c238196609'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.537147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] The token cache is being invalidate because project 0d52269518a248b9b9bd873cc50c554e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:21.537370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.538011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dea25216-6dac-4b00-9ca2-b8c238196609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:21.538416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 872/1723] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/users => generated 287 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:21.539299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.540064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 852/1724] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:21 2022] DELETE /identity/v3/projects/0d52269518a248b9b9bd873cc50c554e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:21.541705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.545834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.546121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.546399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.571673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:21.573111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.616773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9307c8f-293a-4a5d-bf90-9695b4dcd40f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.649984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 853/1725] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:21.657329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.658411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.670694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d311cfd5-86ee-4281-8043-b64b6486130e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.675617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.675911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.676233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.676518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.676615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.676800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.676952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.677145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.677626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.679050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.679292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e35853-ab87-4c1a-970c-69722add932c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.690861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 854/1726] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:21.692679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.693066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.693374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.694893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.696377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.706815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 873/1727] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:21.707632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.715359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:21.716588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.718324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ac807-77d9-4f16-a6be-135b755d37a7 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.723152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.723778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.724066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.724341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.725031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.725455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 855/1728] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:21.730664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.730796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.742463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 874/1729] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:21.742634 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360632b-1d01-4936-90ee-0b65d915c014 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.743904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.744753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.745401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.745679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.745950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.747012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:21.747012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.748559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.753875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5da24-49c1-4c5c-904c-cc29e1276910 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.758557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.759252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.759584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.759862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] PATH_INFO: `/v3/projects/3b9f37b29127424a925e8f57ba699a88/users/553ebe9ac6a14cda9245666f80fdfb1f/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.763720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 856/1730] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:21.764666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.774374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f284c2c-a2c7-4a02-a7ab-6f6c4d39beb4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.775657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b9f37b29127424a925e8f57ba699a88, user_id=553ebe9ac6a14cda9245666f80fdfb1f, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.778213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.781991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:21.782830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.783118 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.787928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.787928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:21.787928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872b8a4-103b-459d-9d0c-0706d4534774 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:21.867381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 875/1731] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:21 2022] PUT /identity/v3/projects/3b9f37b29127424a925e8f57ba699a88/users/553ebe9ac6a14cda9245666f80fdfb1f/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:21.869957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:21.870882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.902210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 857/1732] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:21.903323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:21.903620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:21.903900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:21.934912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] MFA Rules not processed for user `553ebe9ac6a14cda9245666f80fdfb1f`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:21.936327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:21.943530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5661a55-75d8-4ffe-9e49-264bd68a15d3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:21.980803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:22.022371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 858/1733] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:22.023227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.026186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.027140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.028356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.028779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] PATH_INFO: `/v3/projects/a4bc99ac363641b989b526302047b112` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.031198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4bc99ac363641b989b526302047b112)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.033365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.051580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b717fd0e-8591-4cb4-bdb9-a581559d2fe2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.056992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.057655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.064888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.065236 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.065921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.074609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.160520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4bc99ac363641b989b526302047b112', 'request_id': 'req-eb1dca1f-2cf5-4b37-8d0c-12741256b110'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.166827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4bc99ac363641b989b526302047b112', 'request_id': 'req-eb1dca1f-2cf5-4b37-8d0c-12741256b110'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.203714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 859/1734] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:22 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:22.203714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.205109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.262135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4bc99ac363641b989b526302047b112', 'request_id': 'req-eb1dca1f-2cf5-4b37-8d0c-12741256b110'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.276319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] The token cache is being invalidate because project a4bc99ac363641b989b526302047b112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:22.276657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.277404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.280241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 876/1735] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:21 2022] DELETE /identity/v3/projects/a4bc99ac363641b989b526302047b112 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:22.280579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.281876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.287611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126b0fd5-29e7-4feb-9bc1-e7875a07b96a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.352634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1dca1f-2cf5-4b37-8d0c-12741256b110 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.355619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.356249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.356526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.356912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.357762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.358511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.358693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.358813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.359087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.359744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.361398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.372276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 877/1736] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:22.373114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.374844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.388473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:22.391376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374e328-94bc-41a8-aff7-f542cd0f27a4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.396788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.397577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.397716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.398037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] PATH_INFO: `/v3/projects/f376aea87afd4fa5b8b7af5cc0a0540e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.399162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f376aea87afd4fa5b8b7af5cc0a0540e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.401702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.423896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.425523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2321533-1520-4dcf-96ed-0871282358c6 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.434649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 860/1737] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:22.435872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.436149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.436424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.459406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:22.459406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.467992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 861/1738] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:22.468871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.487266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c072b-93f0-4802-a978-4b1cfa72d9b6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.495705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.496484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.496865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.497286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.498075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.499903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a39e2e-00f0-440c-93eb-3fe4d929a6ee admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.520881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 862/1739] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:22.523136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.523667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.523945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.530704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f376aea87afd4fa5b8b7af5cc0a0540e', 'request_id': 'req-45a4c5ea-3939-44e6-a124-c2c11a4b5326'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.538978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f376aea87afd4fa5b8b7af5cc0a0540e', 'request_id': 'req-45a4c5ea-3939-44e6-a124-c2c11a4b5326'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.546641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:22.547917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.624485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 863/1740] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:22.625507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.636955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27726e3-437a-42b3-a46f-4781a6ca42a0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.639550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f376aea87afd4fa5b8b7af5cc0a0540e', 'request_id': 'req-45a4c5ea-3939-44e6-a124-c2c11a4b5326'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.651441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.651441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.651441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.651441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] PATH_INFO: `/v3/projects/3cb6c2ae2d0e49b2b70bcda9b4bb9aa4/users/0b6a49a946c94580bb29369c808ae931/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.652708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] The token cache is being invalidate because project f376aea87afd4fa5b8b7af5cc0a0540e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:22.652891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.653603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.655277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 878/1741] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:22 2022] DELETE /identity/v3/projects/f376aea87afd4fa5b8b7af5cc0a0540e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:22.656110 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.659514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.673325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb6c2ae2d0e49b2b70bcda9b4bb9aa4, user_id=0b6a49a946c94580bb29369c808ae931, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.677351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.693748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4c5ea-3939-44e6-a124-c2c11a4b5326 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.699506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.700137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.700419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.700770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.702157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:22.702157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.703599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.716618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 879/1742] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:22.717591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.720487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.732221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc658849-baab-4bb8-9062-3d5db4f11868 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.737214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.743374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.743374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.743374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] PATH_INFO: `/v3/users/08df35477a404a278dbee7a2b6cedf8f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.743374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08df35477a404a278dbee7a2b6cedf8f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.743374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.761069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 864/1743] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:22 2022] PUT /identity/v3/projects/3cb6c2ae2d0e49b2b70bcda9b4bb9aa4/users/0b6a49a946c94580bb29369c808ae931/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:22.767253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:22.767253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:22.846544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456f6b2d-7e91-440f-ab75-ad6e6db88076 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:22.851341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:22.851976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:22.852257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:22.852532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] PATH_INFO: `/v3/users/553ebe9ac6a14cda9245666f80fdfb1f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:22.854220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553ebe9ac6a14cda9245666f80fdfb1f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:22.856162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:22.986436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08df35477a404a278dbee7a2b6cedf8f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:22.994310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08df35477a404a278dbee7a2b6cedf8f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.012465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:23.014049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08df35477a404a278dbee7a2b6cedf8f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.014785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08df35477a404a278dbee7a2b6cedf8f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.064858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553ebe9ac6a14cda9245666f80fdfb1f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.072251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553ebe9ac6a14cda9245666f80fdfb1f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.072964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553ebe9ac6a14cda9245666f80fdfb1f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.114090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08df35477a404a278dbee7a2b6cedf8f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.123354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 880/1744] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:22 2022] DELETE /identity/v3/users/08df35477a404a278dbee7a2b6cedf8f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:23.123354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.123546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.191640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1634c4-f1e1-4d6b-b1c7-35360438b3cd admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.196429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.197137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.197432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.197712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.198659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.201747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.201861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553ebe9ac6a14cda9245666f80fdfb1f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.220078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0683439a-a02c-4470-ba17-8502fe378386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553ebe9ac6a14cda9245666f80fdfb1f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.229867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 865/1745] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:22 2022] DELETE /identity/v3/users/553ebe9ac6a14cda9245666f80fdfb1f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:23.229867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a134a-6028-4eab-a118-1732c5495928 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.229867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a134a-6028-4eab-a118-1732c5495928 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.229867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a134a-6028-4eab-a118-1732c5495928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.256494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-435a134a-6028-4eab-a118-1732c5495928 None None] MFA Rules not processed for user `0b6a49a946c94580bb29369c808ae931`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:23.257722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-435a134a-6028-4eab-a118-1732c5495928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.328012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 866/1746] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:23.329666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.329906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.330255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.336239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 881/1747] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:23.337058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.339389 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.350518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:23.351853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.413982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7dd46-5e15-4ffe-8ed5-778bdf4f1b63 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.423046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 867/1748] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:23.423241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.423355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.423442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.423442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.423442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.423683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.425224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.427658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.505455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce71342-e5b6-4bc3-b3e3-380f7f03d2ea None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.509332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.513566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.513566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.513566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.569541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.570987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.580638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 868/1749] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:23.581548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.588255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.612677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:23.622905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 882/1750] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:23.630215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.635435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.647226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9405ac-3bda-4b21-a51a-b7021161d6db service glance] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.653159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.657069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.657069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.657069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.658439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0b10f-f4ed-47d7-8e2a-ab4bb6512312 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.666013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.666570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.666782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.667133 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.667558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] PATH_INFO: `/v3/projects/15a784715e90449689d161f5783dede3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.668649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.668791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a784715e90449689d161f5783dede3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.670954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.680256 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 869/1751] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:23.680800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.692552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd374b9f-448b-4fc9-87fc-6496430585bd service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.702125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.702780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.703243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.703492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.704150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.705827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.719916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 870/1752] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:23.722303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.735935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6694e-fb2f-4a46-9ce3-8d37337e3fb7 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.745842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.746787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.747672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.748228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.749206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.753738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.776389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 871/1753] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:23.781086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:23.800080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2a0f16-f327-48d5-9dbf-8db4a5a58c22 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:23.805729 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:23.806434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.806721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.808861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] PATH_INFO: `/v3/projects/64784ba25a2d48ee80dc2f7f2f6a48cb/users/9b3cbb229cdf43b8859e687804afcc70/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.828254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64784ba25a2d48ee80dc2f7f2f6a48cb, user_id=9b3cbb229cdf43b8859e687804afcc70, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:23.831582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae960f13-ac03-46bb-8ea2-4b7d8dae3466 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:23.850034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a784715e90449689d161f5783dede3', 'request_id': 'req-3f52c14b-5bf9-496b-bd46-d221ea66be06'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.860694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a784715e90449689d161f5783dede3', 'request_id': 'req-3f52c14b-5bf9-496b-bd46-d221ea66be06'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.921373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 872/1754] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:23 2022] PUT /identity/v3/projects/64784ba25a2d48ee80dc2f7f2f6a48cb/users/9b3cbb229cdf43b8859e687804afcc70/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:23.932286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89a91-1198-4506-9d1d-7c410d91259d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.932572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89a91-1198-4506-9d1d-7c410d91259d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.932847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f89a91-1198-4506-9d1d-7c410d91259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:23.965323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a784715e90449689d161f5783dede3', 'request_id': 'req-3f52c14b-5bf9-496b-bd46-d221ea66be06'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.972905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-21f89a91-1198-4506-9d1d-7c410d91259d None None] MFA Rules not processed for user `9b3cbb229cdf43b8859e687804afcc70`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:23.975532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-21f89a91-1198-4506-9d1d-7c410d91259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:23.978087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] The token cache is being invalidate because project 15a784715e90449689d161f5783dede3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:23.978545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.979219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3f52c14b-5bf9-496b-bd46-d221ea66be06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:23.982879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 883/1755] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:23 2022] DELETE /identity/v3/projects/15a784715e90449689d161f5783dede3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:23.989256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:23.989842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:23.989842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.022541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:24.023874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.061945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 873/1756] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:24.087221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 884/1757] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:24.095239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.095530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.095795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.116738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:24.118082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.127996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 874/1758] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:24.132177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.142425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912d2d2-df6c-42ea-879d-9c97441f0091 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.147308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.147929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.153457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.153457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.153457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:24.153457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.153457 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.162995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 885/1759] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:24.167460 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.177160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81b646-ac11-4b6c-bbe1-c1c2b45822c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.179960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.182692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.186108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.186791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.187084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.187479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.188280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.190217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.203383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:24.210818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ede4c8-1d90-4cb0-aa4b-57e01b2ff391 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.215952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.216655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.217078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.217386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] PATH_INFO: `/v3/projects/3b9f37b29127424a925e8f57ba699a88` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.218504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b9f37b29127424a925e8f57ba699a88)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.227417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.301696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 875/1760] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:24.302650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.342114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b9f37b29127424a925e8f57ba699a88', 'request_id': 'req-e98711c6-39af-49c9-9948-f03548700e81'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:24.350499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b9f37b29127424a925e8f57ba699a88', 'request_id': 'req-e98711c6-39af-49c9-9948-f03548700e81'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:24.374154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0115a-b74c-49be-b210-7d8ec6456459 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.425176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:24.429450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b9f37b29127424a925e8f57ba699a88', 'request_id': 'req-e98711c6-39af-49c9-9948-f03548700e81'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:24.434733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.435357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.435645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.435943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.436567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.438530 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.441921 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] The token cache is being invalidate because project 3b9f37b29127424a925e8f57ba699a88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:24.442218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:24.442873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e98711c6-39af-49c9-9948-f03548700e81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:24.444449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 886/1761] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:24 2022] DELETE /identity/v3/projects/3b9f37b29127424a925e8f57ba699a88 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:24.449339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccac2-bb72-4d86-8011-702c287f3ba2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.449626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccac2-bb72-4d86-8011-702c287f3ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.449968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faccac2-bb72-4d86-8011-702c287f3ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.469060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9faccac2-bb72-4d86-8011-702c287f3ba2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:24.470324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9faccac2-bb72-4d86-8011-702c287f3ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.478770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 887/1762] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:24.487449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.487734 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.488007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.507794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:24.508990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.516860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 888/1763] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:24.520815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.529785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85b3c8-ef33-407a-a8b5-0b6f89948929 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.537167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 876/1764] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/users => generated 287 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:24.537751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.541912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.541912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.541912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.541912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:24.541912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.542482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.545020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.546787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.566092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 889/1765] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:42:24.567759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.570714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.573698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb05b87-01c5-4d23-a02a-b2995073e084 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.579173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.579817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.580104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.580380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.581031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.582870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.594655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 877/1766] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:24.595379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.611801 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed5a8a5-3c29-49b1-9088-93aad22c6548 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.619853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.622380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.622380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.622380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.622380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.623838 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.643391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5c2f0-2ed9-48fb-9659-87a11089fad8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.651463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.651463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.651463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.651463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.652544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.718026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.719636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.731177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 878/1767] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:24.731177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.731443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 890/1768] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:24.732587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.743985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfff6ed-b23e-4833-ae2e-b05868ae49fa service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.799425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d520a-e36f-4b7c-bbba-65abe65464ee admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.804107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.804715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.804991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.805299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.805955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.807581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.810128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.810846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.811232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.811683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.812319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.814541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.817795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 879/1769] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:24.818558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.822466 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:24.835887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bf12d-889b-4886-b0e0-aa292d931d97 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.841713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.842336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.842614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.842884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] PATH_INFO: `/v3/users/9b3cbb229cdf43b8859e687804afcc70` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.843998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3cbb229cdf43b8859e687804afcc70)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.845933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:24.896857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 891/1770] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:24 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:24.897735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:24.907729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3222b79-8348-4d1a-afa9-e12474422801 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:24.913645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:24.914286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:24.914564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:24.914829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] PATH_INFO: `/v3/projects/b85a0f2f3acf481da0898dfdbf87d5da/users/5265eb540bc34f44b53def5cf8badbbf/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:24.930104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85a0f2f3acf481da0898dfdbf87d5da, user_id=5265eb540bc34f44b53def5cf8badbbf, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:24.932717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.046696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 892/1771] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:24 2022] PUT /identity/v3/projects/b85a0f2f3acf481da0898dfdbf87d5da/users/5265eb540bc34f44b53def5cf8badbbf/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:25.050703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.056367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3cbb229cdf43b8859e687804afcc70'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:25.063572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3cbb229cdf43b8859e687804afcc70'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:25.064358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3cbb229cdf43b8859e687804afcc70'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:25.119478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd1a83-b090-4bcd-96d9-90c2d8e33739 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.125438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.132181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.132181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.132181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.132181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.132181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77f3220-ea9e-48f5-bdc3-25259a07c340 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.139824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 893/1772] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:25.141089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.141398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.141674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.160977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:25.162263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.170174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 894/1773] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:25.170944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.172161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.180017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3cbb229cdf43b8859e687804afcc70'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:25.184386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d885ce-d6c6-4a04-8dc1-1006fc02601d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.189251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.190005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.190286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.190559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.191207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.192850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.194682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0283a921-b344-4ea6-a296-b94f0c50ea72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3cbb229cdf43b8859e687804afcc70'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:25.206131 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 895/1774] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:25.207132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.207989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 880/1775] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:24 2022] DELETE /identity/v3/users/9b3cbb229cdf43b8859e687804afcc70 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:25.213590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.214389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.214859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.215026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.240844 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:25.242481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.284262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f700a5-1ada-4454-a79b-e88ca6312d66 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.309713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 881/1776] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:25.310835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.320458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7515992-82fd-41ad-85c7-93d248dfcbb5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.325822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.326798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.327050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.327331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] PATH_INFO: `/v3/projects/8161c099214d4092aa0dbf5035c38c1d/users/e0359f6662094f81bebdf54222a096d2/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.344901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8161c099214d4092aa0dbf5035c38c1d, user_id=e0359f6662094f81bebdf54222a096d2, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.347632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.348480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.349105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.350059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.350368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.360974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.363784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.374410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 896/1777] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:25.375344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.376759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.387963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a0fa3-a869-49c5-a8a1-60f5176c37b5 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.391882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.392487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.392770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.393048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.402933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.404350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0db84-80ea-4863-84d7-8e94c09b65fb service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.414567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 897/1778] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:25.430605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 882/1779] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:25 2022] PUT /identity/v3/projects/8161c099214d4092aa0dbf5035c38c1d/users/e0359f6662094f81bebdf54222a096d2/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:25.439912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.440132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.440442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.446083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:25.474498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] MFA Rules not processed for user `e0359f6662094f81bebdf54222a096d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:25.475856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.554552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 898/1780] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:25.569439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.572413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:25.645740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9ac4b-c266-4826-a81b-aa7558a82cc1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:25.649642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:25.650816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:25.651099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:25.651422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:25.675393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:25.676886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66416bac-48c6-4f5f-8c52-f90293feab00 service glance] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:25.716487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:25.721892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 883/1781] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:25.905207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:25.910439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:26.002225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5b4cb-52f7-4ba5-8447-33568f9415d0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.014808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.015469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.015754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.016030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] PATH_INFO: `/v3/projects/64784ba25a2d48ee80dc2f7f2f6a48cb` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.017221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64784ba25a2d48ee80dc2f7f2f6a48cb)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.019390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.193295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64784ba25a2d48ee80dc2f7f2f6a48cb', 'request_id': 'req-dfe396ff-8710-4299-8f7d-540046ae68a6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:26.202669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64784ba25a2d48ee80dc2f7f2f6a48cb', 'request_id': 'req-dfe396ff-8710-4299-8f7d-540046ae68a6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:26.292228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:26.314290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64784ba25a2d48ee80dc2f7f2f6a48cb', 'request_id': 'req-dfe396ff-8710-4299-8f7d-540046ae68a6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:26.335379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] The token cache is being invalidate because project 64784ba25a2d48ee80dc2f7f2f6a48cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:26.335379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:26.340557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-dfe396ff-8710-4299-8f7d-540046ae68a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:26.340557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 899/1782] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:25 2022] DELETE /identity/v3/projects/64784ba25a2d48ee80dc2f7f2f6a48cb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:26.344439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.344945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.346860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.366831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:26.369285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:26.431837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 884/1783] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:26.439834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.440361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.440698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.463707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:26.464879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:26.476554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 900/1784] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:26.481947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.492034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576000a-8dae-47e9-a43c-8b1cfb880a03 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.498026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.498631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.498914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.499187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.499837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:26.500144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.501822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.513974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 885/1785] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:26.518560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.529040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bc578-df27-4785-aa58-79accf8fbcca None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.535647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.536676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.537076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.537500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.538274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.540299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.652051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 901/1786] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:26 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:26.653986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.664284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880e898-59e9-46b9-be2e-816da161ea2e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.701414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:26.727518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.728034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.728315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.728589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.729261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.731188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.832025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 886/1787] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:26 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:26.836582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.855696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac370a-9eb9-45e4-9a50-e56884247219 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.861085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.861787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.862127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.862460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.863189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.865336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.877168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 902/1788] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:26.881116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.892662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bd262-f840-4134-9f81-8782e2060ffd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.898214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.899408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.899682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.900549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.901418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.903179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f551d0e6-1473-4530-8612-5578d8528ddb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:26.917169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 887/1789] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:26.921355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:26.931501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06830-35d2-424b-bb78-026ae8c03728 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:26.936209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:26.936858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:26.937176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:26.937456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] PATH_INFO: `/v3/projects/5ebc34b737bb4171b69aa8a6dfff9efc/users/3dbc65982d2a4391a4d708f9383b050f/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:26.953940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ebc34b737bb4171b69aa8a6dfff9efc, user_id=3dbc65982d2a4391a4d708f9383b050f, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:26.956588 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f771f3a-78b5-4c85-91b1-a08ad8c4230c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.021586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:27.052954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 903/1790] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:26 2022] PUT /identity/v3/projects/5ebc34b737bb4171b69aa8a6dfff9efc/users/3dbc65982d2a4391a4d708f9383b050f/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:27.120954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.121443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.121810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.159831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] MFA Rules not processed for user `3dbc65982d2a4391a4d708f9383b050f`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:27.159971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.160221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.160550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.161067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:27.203380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] MFA Rules not processed for user `5265eb540bc34f44b53def5cf8badbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:27.208318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:27.253247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 888/1791] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:27.266491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.268384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:27.284278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 904/1792] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:27.291320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.299534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:27.367553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8a351-5d92-4772-8f67-7286cf6c83bd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.372980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.374092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.374383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.374716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.386081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.388052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.403187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a68425-8ae0-484b-83ac-3a3a6bdc6053 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.413545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.414235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.414529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.414809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.415065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 889/1793] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:27.416514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.418531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.451768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:27.525561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 905/1794] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:27 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:27.529648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.543340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef45467-15cd-443f-b6d8-c45519f9efa8 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.611316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.611938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.612222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.612498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.613146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.615076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.663445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:27.722652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 890/1795] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:27 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:27.725606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.739015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44714cbb-7f98-49c5-b598-65d0a6703132 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.750397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.752406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.752878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.753105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.753772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.755546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.771043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 906/1796] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:27.775835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.787619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94dc4-8f87-4c41-b2d5-cf3c08e8a43c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.794385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.795638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.796033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.796370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] PATH_INFO: `/v3/projects/310e92cbf1a54689af52c2388dff453c/users/5062d351c7484839bb7d5be7b1ebb9fb/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.815482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e92cbf1a54689af52c2388dff453c, user_id=5062d351c7484839bb7d5be7b1ebb9fb, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.818184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.903702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 891/1797] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:27 2022] PUT /identity/v3/projects/310e92cbf1a54689af52c2388dff453c/users/5062d351c7484839bb7d5be7b1ebb9fb/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:27.908003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:27.921067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b2aa29-a606-4c7f-9457-dc94e6f560dd admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:27.981477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:27.982487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:27.982983 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:27.983503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:27.984411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:27.986083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189105c-7f8b-4530-8a1e-1945fe57f64c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:27.996578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 907/1798] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:28.000965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:28.019111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a17419-1361-4683-8e87-107fa9ff16cf admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:28.024236 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:28.025454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:28.025787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:28.026694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] PATH_INFO: `/v3/projects/310e92cbf1a54689af52c2388dff453c/users/5062d351c7484839bb7d5be7b1ebb9fb/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:28.028706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=310e92cbf1a54689af52c2388dff453c, user_id=5062d351c7484839bb7d5be7b1ebb9fb, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:28.031542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:28.043608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 892/1799] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:27 2022] PUT /identity/v3/projects/310e92cbf1a54689af52c2388dff453c/users/5062d351c7484839bb7d5be7b1ebb9fb/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:28.444184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:28.698242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:29.321291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:29.643136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c632-90a6-4021-b3e5-5a045ae88299 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:29.643646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c632-90a6-4021-b3e5-5a045ae88299 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:29.644911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123c632-90a6-4021-b3e5-5a045ae88299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:29.656607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:29.658386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:29.675006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0123c632-90a6-4021-b3e5-5a045ae88299 None None] MFA Rules not processed for user `5062d351c7484839bb7d5be7b1ebb9fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:29.676228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0123c632-90a6-4021-b3e5-5a045ae88299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:29.742779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff00535-e18b-42c6-ae64-cee0c77f4a2c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:29.747582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:29.748222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:29.748508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:29.748911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] PATH_INFO: `/v3/users/de17639444d14b8aa7134fda51a39cba` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:29.750051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de17639444d14b8aa7134fda51a39cba)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:29.751993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:29.761312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 908/1800] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:29.764313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:29.764611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:29.764887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:29.785581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] MFA Rules not processed for user `5265eb540bc34f44b53def5cf8badbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:29.786975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:29.851502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 909/1801] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:29.863438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:29.864897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:29.938727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787a805-d16f-4f9e-9cc1-d739f2583cd2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:29.944252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:29.944862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:29.945169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:29.945452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:29.953909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:29.955527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02f3b6-0442-419d-9f9d-191013da74b4 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:29.965657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 910/1802] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:29.972927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de17639444d14b8aa7134fda51a39cba'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:29.980544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de17639444d14b8aa7134fda51a39cba'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:29.981508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de17639444d14b8aa7134fda51a39cba'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:29.984550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:30.049857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de17639444d14b8aa7134fda51a39cba'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.063732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de17639444d14b8aa7134fda51a39cba'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.069713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 893/1803] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:29 2022] DELETE /identity/v3/users/de17639444d14b8aa7134fda51a39cba => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:30.074820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:30.075181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:30.075478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:30.095445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:30.096622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.161373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 911/1804] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:30.172673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:30.174445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.234707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:30.238353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67c39a-add6-42ff-8bb7-7dce42d6b033 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:30.242447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:30.243101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:30.245142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:30.245142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:30.254002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:30.255592 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:30.267492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 894/1805] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:30.495170 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:30.496991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.509020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd9ab-f1ea-4c18-a981-2760b4a9b9ce None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:30.513858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:30.514493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:30.515144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:30.515144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] PATH_INFO: `/v3/users/3dbc65982d2a4391a4d708f9383b050f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:30.516169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbc65982d2a4391a4d708f9383b050f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:30.518239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:30.536719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:30.687910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:30.689433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.703620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472eaac-effa-4e56-ae42-f55211c4223a service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:30.708928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:30.716434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:30.716434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:30.716434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] PATH_INFO: `/v3/projects/71fa5f2c0a494efd9eb53a396bc36d7e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:30.716434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=71fa5f2c0a494efd9eb53a396bc36d7e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:30.716434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:30.737851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbc65982d2a4391a4d708f9383b050f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.745527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbc65982d2a4391a4d708f9383b050f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.757304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbc65982d2a4391a4d708f9383b050f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.758013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbc65982d2a4391a4d708f9383b050f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.838903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b10ea71d-d4ab-452d-8ac6-97de34112c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbc65982d2a4391a4d708f9383b050f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.846826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 912/1806] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:30 2022] DELETE /identity/v3/users/3dbc65982d2a4391a4d708f9383b050f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:30.851391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:30.851705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:30.851946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:30.866821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71fa5f2c0a494efd9eb53a396bc36d7e', 'request_id': 'req-b0702a4b-7884-4974-8f44-d0cb6718ba5b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.872395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71fa5f2c0a494efd9eb53a396bc36d7e', 'request_id': 'req-b0702a4b-7884-4974-8f44-d0cb6718ba5b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.874240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:30.875486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.878786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71fa5f2c0a494efd9eb53a396bc36d7e', 'request_id': 'req-b0702a4b-7884-4974-8f44-d0cb6718ba5b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.902948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:30.935984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 913/1807] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:30.945648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:30.946970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:30.959371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] The token cache is being invalidate because project 71fa5f2c0a494efd9eb53a396bc36d7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:30.959666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.960296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:30.961830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 895/1808] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:30 2022] DELETE /identity/v3/projects/71fa5f2c0a494efd9eb53a396bc36d7e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:30.965522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:30.971248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:30.971248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:31.011134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0b065-470c-48fd-a2f5-5a4a9d2685ca None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:31.014741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:31.015359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:31.015636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:31.015908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:31.017713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:31.030794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:31.032274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:31.044386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0702a4b-7884-4974-8f44-d0cb6718ba5b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:31.045379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 914/1809] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:42:31.049312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:31.050043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:31.050412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:31.050752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] PATH_INFO: `/v3/users/8585763a4ffa42cc964ee3e9519ca162` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:31.052031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8585763a4ffa42cc964ee3e9519ca162)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:31.054182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:31.091805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:31.226033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8585763a4ffa42cc964ee3e9519ca162'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.233866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8585763a4ffa42cc964ee3e9519ca162'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.234646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8585763a4ffa42cc964ee3e9519ca162'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.303500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8585763a4ffa42cc964ee3e9519ca162'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.318258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:31.325110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8585763a4ffa42cc964ee3e9519ca162'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.332865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 896/1810] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:30 2022] DELETE /identity/v3/users/8585763a4ffa42cc964ee3e9519ca162 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:31.538286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:31.539805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:31.559955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca43c-6b89-4deb-8be3-748c972c37e2 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:31.619661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:31.631952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:31.632645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:31.632930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:31.633267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] PATH_INFO: `/v3/projects/5ebc34b737bb4171b69aa8a6dfff9efc` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:31.635003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ebc34b737bb4171b69aa8a6dfff9efc)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:31.636924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:31.772664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ebc34b737bb4171b69aa8a6dfff9efc', 'request_id': 'req-e52530c5-4ae4-4b59-973d-0e820d313560'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.779249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ebc34b737bb4171b69aa8a6dfff9efc', 'request_id': 'req-e52530c5-4ae4-4b59-973d-0e820d313560'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.792913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:31.794420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:31.808082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae496-c781-4d60-b640-f63bd003c381 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:31.864618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:31.865296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:31.865578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:31.865889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] PATH_INFO: `/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:31.867262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e51f8a13d71b4bcd86fe62f96790cb99)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:31.869927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:31.870803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ebc34b737bb4171b69aa8a6dfff9efc', 'request_id': 'req-e52530c5-4ae4-4b59-973d-0e820d313560'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.885917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] The token cache is being invalidate because project 5ebc34b737bb4171b69aa8a6dfff9efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:31.886209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.886900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-e52530c5-4ae4-4b59-973d-0e820d313560 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.900923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 915/1811] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:31 2022] DELETE /identity/v3/projects/5ebc34b737bb4171b69aa8a6dfff9efc => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:31.920096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:31.987906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e51f8a13d71b4bcd86fe62f96790cb99', 'request_id': 'req-7e01dc75-00ac-4eb7-afd9-63765370c84c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:31.994541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e51f8a13d71b4bcd86fe62f96790cb99', 'request_id': 'req-7e01dc75-00ac-4eb7-afd9-63765370c84c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:32.001625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e51f8a13d71b4bcd86fe62f96790cb99', 'request_id': 'req-7e01dc75-00ac-4eb7-afd9-63765370c84c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:32.079814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] The token cache is being invalidate because project e51f8a13d71b4bcd86fe62f96790cb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:32.080116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:32.081010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7e01dc75-00ac-4eb7-afd9-63765370c84c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:32.082585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 897/1812] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:31 2022] DELETE /identity/v3/projects/e51f8a13d71b4bcd86fe62f96790cb99 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:32.087513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.087827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.088105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.112881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:32.114211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:32.177560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 916/1813] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:32.189065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.189405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.189682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.200905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:32.211071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:32.212311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:32.221064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 898/1814] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:32.225403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.235864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445377-6b52-430f-b34e-dd3819dcd286 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.240507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.241107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.241421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.241698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.242343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:32.244115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.244321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.255998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 917/1815] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:32.260373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.270109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13676-2515-4812-ba0d-7a384994e0a6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.275394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.275993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.276269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.276538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.277207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.279107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.412813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 899/1816] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:32.417755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.428371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306fecb-33c9-449c-a5a3-e12458de2f31 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.485661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.486275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.486558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.486833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.487473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.489427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.564808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 918/1817] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:32.568117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:32.571720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.583119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81151f5d-3a5d-46d6-9d4e-567f7eba09a3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.588260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.588869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.589176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.589449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.592703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.592703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.601879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 900/1818] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:32.606093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.623316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae2fc-8df7-4e97-98f3-26ae803991a1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.628230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.628845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.629155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.629479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.630104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.631707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c828937-3574-4ca6-814a-e4c43a623f5e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.644177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 919/1819] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:32.648535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.659866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce726f-fed9-4b62-b875-a148213c81b0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.664871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.665577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.665873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.666152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] PATH_INFO: `/v3/projects/e0859b2812f64f4e98b830d8e995efe5/users/4821659e88f043c1ba849106e0a3a089/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.686966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0859b2812f64f4e98b830d8e995efe5, user_id=4821659e88f043c1ba849106e0a3a089, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.689717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:32.789312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 901/1820] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:32 2022] PUT /identity/v3/projects/e0859b2812f64f4e98b830d8e995efe5/users/4821659e88f043c1ba849106e0a3a089/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:32.799731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.800023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.800301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.811787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:32.830740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] MFA Rules not processed for user `4821659e88f043c1ba849106e0a3a089`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:32.832121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:32.840047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:32.899021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 920/1821] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:32.904291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:32.926904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:32.973237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c40ed9-6c7a-45a9-8f6a-6886d9e25900 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:32.977945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:32.978581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:32.978863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:32.979139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:32.979777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:32.981763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.012154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.064651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 902/1822] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:32 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:33.069065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.081323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d17d03-13fe-4433-bb24-52fd9f8cc23d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.139391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.139922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.140201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.140509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.141173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.142745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.143097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.165561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.206638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 921/1823] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:33 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:33.211032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.213950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.223686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334b2004-1cb2-46a0-91a7-13d2437c72e4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.228521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.229139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.229426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.229698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.230363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.234735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.243597 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 903/1824] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:33.248325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.258240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a583c3b-c624-46f4-bce0-773edaef3900 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.263450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.264092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.264369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.264642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] PATH_INFO: `/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa/users/4a2cf0b82c804f9abb1e1a5582ee05cc/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.279729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ccba12113b4d4486b3ed9fb9ebbaaa, user_id=4a2cf0b82c804f9abb1e1a5582ee05cc, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.282458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.355149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 922/1825] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:33 2022] PUT /identity/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa/users/4a2cf0b82c804f9abb1e1a5582ee05cc/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:33.359207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.370313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f17fff-320f-4d96-808f-00d0105d258f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.428445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.428982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.429295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.429574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.430222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.432454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6faf789-6a9b-415b-b182-b3eea4732143 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.442463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 904/1826] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:33.452381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.463645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119de6d-26bd-45b1-b652-fde20c05ea79 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.468398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.472444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.472444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.472444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] PATH_INFO: `/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa/users/4a2cf0b82c804f9abb1e1a5582ee05cc/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.472444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ccba12113b4d4486b3ed9fb9ebbaaa, user_id=4a2cf0b82c804f9abb1e1a5582ee05cc, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.474193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.485004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 923/1827] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:33 2022] PUT /identity/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa/users/4a2cf0b82c804f9abb1e1a5582ee05cc/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:33.491459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.496888 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.497203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.497479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.526057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] MFA Rules not processed for user `4a2cf0b82c804f9abb1e1a5582ee05cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:33.527275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:33.565724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.606939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 905/1828] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:33 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:33.618184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.620476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:33.679015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ce7d4-12b0-40d0-b46b-2817d0ade33d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.683310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.684233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.684233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.684482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.694008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.695557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f62e4d-9647-45fe-acad-738b27a76f4e service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.705622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 924/1829] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:33.754514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.775420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:33.840135 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.846356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011c5b8-56b9-4f24-9e97-3a0a6b9488dd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:33.852273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:33.852273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:33.852273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:33.852273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] PATH_INFO: `/v3/users/4821659e88f043c1ba849106e0a3a089` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:33.853865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4821659e88f043c1ba849106e0a3a089)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:33.855797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:33.897274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:33.960287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.026700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4821659e88f043c1ba849106e0a3a089'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.033737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4821659e88f043c1ba849106e0a3a089'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.034406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4821659e88f043c1ba849106e0a3a089'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.102617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4821659e88f043c1ba849106e0a3a089'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.115794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4821659e88f043c1ba849106e0a3a089'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.122178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 906/1830] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:33 2022] DELETE /identity/v3/users/4821659e88f043c1ba849106e0a3a089 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:34.126643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77994e-3225-40c6-8336-6903f933391f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:34.127117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77994e-3225-40c6-8336-6903f933391f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:34.127205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77994e-3225-40c6-8336-6903f933391f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:34.147513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ff77994e-3225-40c6-8336-6903f933391f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:34.148854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ff77994e-3225-40c6-8336-6903f933391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:34.155038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.207773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.230680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 925/1831] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:34.245990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:34.245990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:34.298405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.309675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7732372-326f-4191-848a-eb95d850dd52 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:34.313650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:34.314267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:34.314546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:34.314816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:34.324984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:34.326707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:34.336602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 907/1832] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:34.394190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.618313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.741660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:34.770999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77994e-3225-40c6-8336-6903f933391f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:34.772463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ff77994e-3225-40c6-8336-6903f933391f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:34.785478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77994e-3225-40c6-8336-6903f933391f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:34.790238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:34.790875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:34.791159 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:34.791505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] PATH_INFO: `/v3/projects/e0859b2812f64f4e98b830d8e995efe5` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:34.792601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0859b2812f64f4e98b830d8e995efe5)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:34.794582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:34.888440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0859b2812f64f4e98b830d8e995efe5', 'request_id': 'req-57b8d0c9-c831-44b1-ab4d-cff973006112'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.894896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0859b2812f64f4e98b830d8e995efe5', 'request_id': 'req-57b8d0c9-c831-44b1-ab4d-cff973006112'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.977274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0859b2812f64f4e98b830d8e995efe5', 'request_id': 'req-57b8d0c9-c831-44b1-ab4d-cff973006112'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.991182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] The token cache is being invalidate because project e0859b2812f64f4e98b830d8e995efe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:34.991477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.992144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:34.997040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 926/1833] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:34 2022] DELETE /identity/v3/projects/e0859b2812f64f4e98b830d8e995efe5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:34.998285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:35.007969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036374-05e9-4592-9f8e-9b56466d70b0 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:35.018673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:35.068389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:35.069371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:35.069651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:35.069926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] PATH_INFO: `/v3/users/4a2cf0b82c804f9abb1e1a5582ee05cc` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:35.071192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a2cf0b82c804f9abb1e1a5582ee05cc)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:35.073188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:35.302905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a2cf0b82c804f9abb1e1a5582ee05cc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.310618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a2cf0b82c804f9abb1e1a5582ee05cc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.311347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a2cf0b82c804f9abb1e1a5582ee05cc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.326117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:35.365665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a2cf0b82c804f9abb1e1a5582ee05cc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.378811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-286c9c4e-e0ec-4cbf-83dd-ad3476632cb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a2cf0b82c804f9abb1e1a5582ee05cc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.384862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 908/1834] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:34 2022] DELETE /identity/v3/users/4a2cf0b82c804f9abb1e1a5582ee05cc => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:35.417808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:35.812880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:35.814426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:35.830498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8d0c9-c831-44b1-ab4d-cff973006112 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:35.889694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:35.890339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:35.890618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:35.890892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] PATH_INFO: `/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:35.892014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ccba12113b4d4486b3ed9fb9ebbaaa)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:35.893975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:35.989883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ccba12113b4d4486b3ed9fb9ebbaaa', 'request_id': 'req-f372f5d8-0b21-41e0-869e-f897d652e7bc'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:35.997522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ccba12113b4d4486b3ed9fb9ebbaaa', 'request_id': 'req-f372f5d8-0b21-41e0-869e-f897d652e7bc'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:36.062995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ccba12113b4d4486b3ed9fb9ebbaaa', 'request_id': 'req-f372f5d8-0b21-41e0-869e-f897d652e7bc'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:36.068877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:36.077600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] The token cache is being invalidate because project 61ccba12113b4d4486b3ed9fb9ebbaaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:36.077930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:36.078610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f372f5d8-0b21-41e0-869e-f897d652e7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:36.080174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 927/1835] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:35 2022] DELETE /identity/v3/projects/61ccba12113b4d4486b3ed9fb9ebbaaa => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:36.085178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.085626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.085874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.105909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:36.107131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:36.175261 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 909/1836] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:36.183648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.183955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.184240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.206913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:36.208137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:36.216751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 928/1837] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:36.221051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.231577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df266aa1-ee3d-433b-8a99-df3197f4e49b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.238237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.238857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.239137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.239409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.240068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:36.240374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.242037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.254728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 910/1838] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:36.259103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.269490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00ce96-79b9-4211-8d16-45cde3d1709b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.274195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.274798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.275079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.275351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.275979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.278002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.363634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 929/1839] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:36.368561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.379253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6e238-4f99-440b-a32d-20e4fde5318d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.448628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.449285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.449563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.449834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.450475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.452661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.561302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 911/1840] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:36.565738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.577114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87986346-3888-454f-b78c-a55b31dabe00 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.581687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.582297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.582582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.582969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.583501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.585176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.595430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 930/1841] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:36.599321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.609734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cba83ac-b359-4637-baf8-87130e4eaf49 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.614297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.614885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.615161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.615433 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.616068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.617696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73acb001-4692-401b-9488-d790cd794535 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.628090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 912/1842] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:36.631995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.641913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defeb39a-25b7-4dbe-8919-c69eed20b851 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.646595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.647242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.647528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.647837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] PATH_INFO: `/v3/projects/65482f7fae784bd99b16b1f76c4e4665/users/62be480df6d9406f89717360448e0f1c/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.667201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65482f7fae784bd99b16b1f76c4e4665, user_id=62be480df6d9406f89717360448e0f1c, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.675918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:36.771971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 931/1843] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:36 2022] PUT /identity/v3/projects/65482f7fae784bd99b16b1f76c4e4665/users/62be480df6d9406f89717360448e0f1c/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:36.783752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.784142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.784308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.813506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] MFA Rules not processed for user `62be480df6d9406f89717360448e0f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:36.814732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:36.853788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:36.880808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 913/1844] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:36.885303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:36.948141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef796478-ab60-495a-ad67-8069fe44e792 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:36.953165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:36.953775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:36.954060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:36.954334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:36.954999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:36.956890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.042546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 932/1845] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:36 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:37.046544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.057511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb5d4e-838d-43f4-aa59-7ddb78a4281d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.116019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.116701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.116833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.117108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.117768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.119686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.223426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 914/1846] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:37 2022] POST /identity/v3/users => generated 302 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:37.227058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.244201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b9df2-79e0-4b2d-baaa-c11c6954e697 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.245773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.245773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.245988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.246262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.246920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.248572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.259591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 933/1847] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:37.264374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.275344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff74adb6-8775-46ab-a23e-f6dd0e0f9354 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.281117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.281697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.281943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.282223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] PATH_INFO: `/v3/projects/66cae89469cf4ff0be49a33beae514d8/users/3b70028bee4a4aec9cb6e47fcc987df1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.297563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cae89469cf4ff0be49a33beae514d8, user_id=3b70028bee4a4aec9cb6e47fcc987df1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.300215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.366508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 915/1848] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:37 2022] PUT /identity/v3/projects/66cae89469cf4ff0be49a33beae514d8/users/3b70028bee4a4aec9cb6e47fcc987df1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:37.371210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.384789 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f563-8569-4ad2-841e-28f0d4617093 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.450351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.451298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.451912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.452254 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.453004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.455125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2043a7-f1bf-4392-91cf-db72629cb5bd admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.461839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:37.469047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 934/1849] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:37.473241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.484387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d768a90-a5d4-482e-ac39-82fa5ccc6fea admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.489049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.489736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.490019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.490298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] PATH_INFO: `/v3/projects/66cae89469cf4ff0be49a33beae514d8/users/3b70028bee4a4aec9cb6e47fcc987df1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.492207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66cae89469cf4ff0be49a33beae514d8, user_id=3b70028bee4a4aec9cb6e47fcc987df1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.495449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.506039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 916/1850] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:37 2022] PUT /identity/v3/projects/66cae89469cf4ff0be49a33beae514d8/users/3b70028bee4a4aec9cb6e47fcc987df1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:37.517997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.518282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.518559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.546712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] MFA Rules not processed for user `3b70028bee4a4aec9cb6e47fcc987df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:37.548046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:37.620393 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 935/1851] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:37.631508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.633262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:37.691097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de92275-5d3c-40bd-b82b-2b1c5374d9e3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.694805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.695436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.695714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.695988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.706393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.707915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.719224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 917/1852] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:37.767501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:37.768926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:37.780639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786958a2-074e-4635-ae4a-0c3cb8a5d18b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:37.784294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:37.784881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:37.785368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:37.785473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:37.846260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:37.847761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbd9c3-44f5-4a2e-85d8-6ded5d3388cb service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:37.858216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 936/1853] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:37 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:42.695233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:42.738910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:42.782099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb3f5-659f-4fb3-9e03-1810b040dd61 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:42.787765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:42.788482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:42.791699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:42.792212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] PATH_INFO: `/v3/users/62be480df6d9406f89717360448e0f1c` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:42.794381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62be480df6d9406f89717360448e0f1c)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:42.796417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:42.974752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62be480df6d9406f89717360448e0f1c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:42.981972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62be480df6d9406f89717360448e0f1c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:42.982640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62be480df6d9406f89717360448e0f1c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.034291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62be480df6d9406f89717360448e0f1c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.047108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62be480df6d9406f89717360448e0f1c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.053312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 918/1854] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:42 2022] DELETE /identity/v3/users/62be480df6d9406f89717360448e0f1c => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:43.058005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:43.058480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:43.058570 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:43.078459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:43.079670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:43.137889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 937/1855] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:43.148149 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:43.149636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:43.209318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f695b4-1130-432b-9661-9a374e71f49c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:43.213228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:43.213935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:43.214334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:43.216159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:43.235142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:43.237418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:43.249453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 919/1856] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:43.754351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:43.756046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:43.771238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a9326-4af6-49cc-99ab-1b93f235fe65 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:43.776765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:43.780240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:43.780240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:43.780240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] PATH_INFO: `/v3/projects/65482f7fae784bd99b16b1f76c4e4665` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:43.780240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65482f7fae784bd99b16b1f76c4e4665)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:43.782186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:43.806844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:43.897937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65482f7fae784bd99b16b1f76c4e4665', 'request_id': 'req-0230c191-dc1f-4f17-b19f-33ac57ac8662'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.904427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65482f7fae784bd99b16b1f76c4e4665', 'request_id': 'req-0230c191-dc1f-4f17-b19f-33ac57ac8662'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.977515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65482f7fae784bd99b16b1f76c4e4665', 'request_id': 'req-0230c191-dc1f-4f17-b19f-33ac57ac8662'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.989739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] The token cache is being invalidate because project 65482f7fae784bd99b16b1f76c4e4665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:43.990032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.990674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:43.992270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 938/1857] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:43 2022] DELETE /identity/v3/projects/65482f7fae784bd99b16b1f76c4e4665 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:43.996168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:44.006580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a5ec5-3cd4-4816-817e-1a6ab0da3773 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:44.064244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:44.071006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:44.071689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:44.071968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:44.072243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] PATH_INFO: `/v3/users/3b70028bee4a4aec9cb6e47fcc987df1` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:44.073451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b70028bee4a4aec9cb6e47fcc987df1)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:44.075495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:44.300204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b70028bee4a4aec9cb6e47fcc987df1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:44.307493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b70028bee4a4aec9cb6e47fcc987df1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:44.308167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b70028bee4a4aec9cb6e47fcc987df1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:44.388878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b70028bee4a4aec9cb6e47fcc987df1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:44.403384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-63c411db-991f-4002-b889-606a6c93321c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b70028bee4a4aec9cb6e47fcc987df1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:44.409976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 920/1858] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:43 2022] DELETE /identity/v3/users/3b70028bee4a4aec9cb6e47fcc987df1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:44.950470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:44.952228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:44.966026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0230c191-dc1f-4f17-b19f-33ac57ac8662 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.031817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.032451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.032737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.033014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] PATH_INFO: `/v3/projects/66cae89469cf4ff0be49a33beae514d8` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.034514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66cae89469cf4ff0be49a33beae514d8)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.036808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.165328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66cae89469cf4ff0be49a33beae514d8', 'request_id': 'req-8bbaf14c-7c05-425e-b835-cbee27400291'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:45.172205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66cae89469cf4ff0be49a33beae514d8', 'request_id': 'req-8bbaf14c-7c05-425e-b835-cbee27400291'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:45.278884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66cae89469cf4ff0be49a33beae514d8', 'request_id': 'req-8bbaf14c-7c05-425e-b835-cbee27400291'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:45.290366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] The token cache is being invalidate because project 66cae89469cf4ff0be49a33beae514d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:45.290655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:45.291296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8bbaf14c-7c05-425e-b835-cbee27400291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:45.292795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 939/1859] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:44 2022] DELETE /identity/v3/projects/66cae89469cf4ff0be49a33beae514d8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:45.297749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.298201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.298328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.319171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:45.320387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:45.391216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 921/1860] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:45.398769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.399057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.403203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.420731 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:45.422045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:45.429938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 940/1861] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:45.434685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.445050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f45c910-2ca6-4e08-b2eb-ad22b34d84d6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.450025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.450664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.450946 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.451223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.452170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:45.452475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.454643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.466571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 922/1862] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:45.471501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.480814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b2ee2-b8a0-4ed4-a9d7-1fe827cd402f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.486259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.486867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.487145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.487415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.488058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.498856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.647698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 941/1863] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:45 2022] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:45.652252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.665643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cdcc50-eefd-449f-91c0-0ca9f33bc3bf admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.741695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.742323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.742607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.742885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.743539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.745613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.754891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:45.838890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 923/1864] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:45 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:45.842717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.854980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75820603-5d32-443b-bfc1-c47da1c29187 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.864146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.865101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.866196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.866196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.866950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.868858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.871362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:45.881908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 942/1865] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:45.884948 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.895841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a8f5d-1c73-46b2-8f65-4c9e514de74c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.901241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.901873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.902496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.902757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:45.903562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:45.905334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb3e13-7fb1-4ea0-ac3d-0df9347d908c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:45.919629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 924/1866] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:45.925630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:45.943545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbd3b20-d92f-4620-a9d0-df7eace26ce3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:45.966201 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:45.967658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:45.967658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:45.967658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] PATH_INFO: `/v3/projects/1376ca01fcc44248b5cdffc9395d528f/users/e59d13c729564f86902cfd29aa9b8ffc/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.007021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1376ca01fcc44248b5cdffc9395d528f, user_id=e59d13c729564f86902cfd29aa9b8ffc, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.010692 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.086306 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 943/1867] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:45 2022] PUT /identity/v3/projects/1376ca01fcc44248b5cdffc9395d528f/users/e59d13c729564f86902cfd29aa9b8ffc/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:46.089639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.089969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.090238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.129308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] MFA Rules not processed for user `e59d13c729564f86902cfd29aa9b8ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:46.130548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:46.199846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 925/1868] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:46 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:46.205230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:46.268231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1d84b-3da7-4d7b-a7b6-cf2da73b7881 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:46.272981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:46.273620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.273900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.274174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.274817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.276719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.382294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 944/1869] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:46 2022] POST /identity/v3/projects => generated 407 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:46.383672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:46.395203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5bad-eb97-436a-bb4f-2d200a3dcfde None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:46.451563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:46.452398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.452678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.453622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.454284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.456237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.722593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 926/1870] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:46 2022] POST /identity/v3/users => generated 310 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:46.726676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:46.738290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb947d-c758-47b7-a2c0-1ccbfa94deba admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:46.745380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:46.745380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.745380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.745380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.745721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.746486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.759977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 945/1871] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:46.763843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:46.775120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429c88-c0d5-4e39-9d92-45fd7544c32c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:46.782164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:46.782958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.783361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.783689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] PATH_INFO: `/v3/projects/2f015fd06d1f43df9bf2f45987b03b20/users/560a7f716e684a4f86465c0d78c81358/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.805095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f015fd06d1f43df9bf2f45987b03b20, user_id=560a7f716e684a4f86465c0d78c81358, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.808048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.878576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 927/1872] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:46 2022] PUT /identity/v3/projects/2f015fd06d1f43df9bf2f45987b03b20/users/560a7f716e684a4f86465c0d78c81358/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:46.894430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:46.904517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd11b64-e327-43b0-8dae-bc7a255f2a07 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:46.967089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:46.967884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:46.968243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:46.968635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:46.969838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:46.971900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eeb0f-295a-4c41-8e0a-3e2db598cf98 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:46.989968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 946/1873] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:46.991182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:47.003182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a9119-b25e-4dd8-a6ff-f97ac0cbfdbd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:47.009525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:47.010431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:47.016910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:47.017295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] PATH_INFO: `/v3/projects/2f015fd06d1f43df9bf2f45987b03b20/users/560a7f716e684a4f86465c0d78c81358/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:47.019870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f015fd06d1f43df9bf2f45987b03b20, user_id=560a7f716e684a4f86465c0d78c81358, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:47.022679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:47.053477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 928/1874] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:46 2022] PUT /identity/v3/projects/2f015fd06d1f43df9bf2f45987b03b20/users/560a7f716e684a4f86465c0d78c81358/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:47.063249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:47.063879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:47.064164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:47.097343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] MFA Rules not processed for user `560a7f716e684a4f86465c0d78c81358`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:47.098686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:47.135560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:47.176653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 947/1875] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:47 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:47.189760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:47.206012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:47.247481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:47.280267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef6e4f-2349-49ef-8eaf-d5c578c93443 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:47.284716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:47.285642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:47.285918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:47.286221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:47.295478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:47.297543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:47.310120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 929/1876] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:47.724340 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:47.735987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632bcf-1ac4-4506-ba3b-b0a234b672f9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:47.748448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:47.749378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:47.749783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:47.750844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:47.836366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:47.838027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcaf497-490c-4166-856c-33959feab1aa service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:47.848032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 948/1877] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:47 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:51.034446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:51.036103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:51.145349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb17c1bb-81b3-4323-9d53-a5559d4c3340 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:51.160177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:51.160759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:51.161040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:51.165388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] PATH_INFO: `/v3/users/e0359f6662094f81bebdf54222a096d2` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:51.165388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0359f6662094f81bebdf54222a096d2)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:51.165388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:51.374036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0359f6662094f81bebdf54222a096d2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:51.381429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0359f6662094f81bebdf54222a096d2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:51.382268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0359f6662094f81bebdf54222a096d2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:51.450162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0359f6662094f81bebdf54222a096d2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:51.476023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0359f6662094f81bebdf54222a096d2'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:51.486987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 930/1878] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:51 2022] DELETE /identity/v3/users/e0359f6662094f81bebdf54222a096d2 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:51.488586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:51.489081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:51.489212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:51.522931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:51.525451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:51.615106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 949/1879] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:51.624992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:51.626548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:51.676584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:51.687423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873b2d5-9f64-410b-9478-3e7700a75ffd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:51.691709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:51.692318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:51.692600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:51.692870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:51.701886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:51.703567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc1e10b-33f0-4205-8568-224a0baae8da service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:51.713533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 931/1880] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:52.225282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:52.227024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:52.243838 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c3354-ab4b-4058-9196-9b9d8aaff9b7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:52.250440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:52.252108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.253029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.253435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] PATH_INFO: `/v3/projects/8161c099214d4092aa0dbf5035c38c1d` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.255346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8161c099214d4092aa0dbf5035c38c1d)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:52.257741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:52.374250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8161c099214d4092aa0dbf5035c38c1d', 'request_id': 'req-a992f0f5-859b-4989-8897-6fefbae6d570'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:52.381171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8161c099214d4092aa0dbf5035c38c1d', 'request_id': 'req-a992f0f5-859b-4989-8897-6fefbae6d570'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:52.423843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8161c099214d4092aa0dbf5035c38c1d', 'request_id': 'req-a992f0f5-859b-4989-8897-6fefbae6d570'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:52.426889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:52.438616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] The token cache is being invalidate because project 8161c099214d4092aa0dbf5035c38c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:52.438993 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:52.439820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a992f0f5-859b-4989-8897-6fefbae6d570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:52.442334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 950/1881] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:52 2022] DELETE /identity/v3/projects/8161c099214d4092aa0dbf5035c38c1d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:52.446741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.447704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.448142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.472445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:52.473871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:52.551377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 932/1882] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:52.570097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.570097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.570097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.590192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:52.591352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:52.600212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 951/1883] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:52.604538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:52.617808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac752b-1437-4944-a12c-d959b85d267e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:52.630347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:52.635129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.635129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.635129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.635129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:52.635129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:52.635725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:52.650182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 933/1884] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:52.654870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:52.666863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90828f-e843-4ff9-8b3a-a36401f50a56 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:52.671994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:52.672646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.672888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.673180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.673815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:52.675746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:52.818064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 952/1885] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:52 2022] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:52.822263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:52.832841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04a1f-2a89-40eb-952c-ab53d88b6ec3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:52.890787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:52.891401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.891687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.892079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.892725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:52.895237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:52.985989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 934/1886] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:52 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:52.986489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:52.993414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a218a-468b-4e0b-be22-0cf8a9b665b1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:52.998164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:52.998782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:52.999060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:52.999330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:52.999977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:53.001646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:53.022191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 953/1887] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:53.023517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:53.033974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db786-c4c6-4a6b-ad0a-40d2bb9817f4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:53.040281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:53.040960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.041412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.041785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.042746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:53.044876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721f0b6-f6b9-41d9-a8d4-534896aff685 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:53.056675 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 935/1888] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:53.060971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:53.071790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a537680-0e73-41fd-b0fd-36d0bafb63b9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:53.076674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:53.077634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.077915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.078221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] PATH_INFO: `/v3/projects/886a5e57ccf64ab69d100081c22bbbbd/users/61a10b54aa134490903942758c55906a/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.094597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886a5e57ccf64ab69d100081c22bbbbd, user_id=61a10b54aa134490903942758c55906a, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:53.098837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:53.189564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 954/1889] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:53 2022] PUT /identity/v3/projects/886a5e57ccf64ab69d100081c22bbbbd/users/61a10b54aa134490903942758c55906a/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:53.203429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.203714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.203988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.233119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] MFA Rules not processed for user `61a10b54aa134490903942758c55906a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:53.234345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:53.276782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:53.300356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 936/1890] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:53.341255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:53.345360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:53.404898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4345c-0d9d-48d7-86ea-3ac7b47a2097 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:53.408550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:53.409271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.409578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.409852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.418394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:53.419890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f266d-73e8-49ba-a229-1b16b2254bb9 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:53.431742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 955/1891] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:53.446091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:53.530429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bf9b3-49fa-47fd-b3b2-ac535dad0c94 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:53.535311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:53.535957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.536243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.536519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] PATH_INFO: `/v3/users/61a10b54aa134490903942758c55906a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.537698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a10b54aa134490903942758c55906a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:53.539689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:53.842906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a10b54aa134490903942758c55906a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:53.850400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a10b54aa134490903942758c55906a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:53.851076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a10b54aa134490903942758c55906a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:53.915494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a10b54aa134490903942758c55906a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:53.934278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a10b54aa134490903942758c55906a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:53.941732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 937/1892] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:53 2022] DELETE /identity/v3/users/61a10b54aa134490903942758c55906a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:53.946267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:53.947761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:53.948103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:53.977094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:53.978740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:54.069445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 956/1893] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:54.093829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:54.095430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:54.166641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0917d1f9-3164-4e4e-adec-829e648558b4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:54.172450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:54.173428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:54.173707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:54.175109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:54.187361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:54.188885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:54.202416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 938/1894] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:54.694466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:54.696775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:54.714485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c850df-15ce-4eaa-9ac6-0c0e0340ee8d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:54.721211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:54.722121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:54.722476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:54.722851 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] PATH_INFO: `/v3/projects/886a5e57ccf64ab69d100081c22bbbbd` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:54.724081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=886a5e57ccf64ab69d100081c22bbbbd)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:54.726316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:54.811813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:54.811813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:54.818395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:54.822167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e013c748-6784-4bac-9e68-f6647a833101 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:54.829119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:54.829821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:54.830089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:54.830407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] PATH_INFO: `/v3/users/e59d13c729564f86902cfd29aa9b8ffc` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:54.831428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:54.832298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59d13c729564f86902cfd29aa9b8ffc)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:54.834773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:54.849136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886a5e57ccf64ab69d100081c22bbbbd', 'request_id': 'req-6cc46bba-5a37-489f-8b57-975de191a4e8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:54.857819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886a5e57ccf64ab69d100081c22bbbbd', 'request_id': 'req-6cc46bba-5a37-489f-8b57-975de191a4e8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:54.943166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886a5e57ccf64ab69d100081c22bbbbd', 'request_id': 'req-6cc46bba-5a37-489f-8b57-975de191a4e8'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:54.954382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] The token cache is being invalidate because project 886a5e57ccf64ab69d100081c22bbbbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:54.954939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:54.955291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6cc46bba-5a37-489f-8b57-975de191a4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:54.956837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 957/1895] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:54 2022] DELETE /identity/v3/projects/886a5e57ccf64ab69d100081c22bbbbd => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:54.961609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac272-b9fa-4bbb-a473-aaba3688a080 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:54.961895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac272-b9fa-4bbb-a473-aaba3688a080 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:54.962167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ac272-b9fa-4bbb-a473-aaba3688a080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:54.981190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-9b8ac272-b9fa-4bbb-a473-aaba3688a080 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:54.982505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9b8ac272-b9fa-4bbb-a473-aaba3688a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:55.025365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59d13c729564f86902cfd29aa9b8ffc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:55.032858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59d13c729564f86902cfd29aa9b8ffc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:55.033644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59d13c729564f86902cfd29aa9b8ffc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:55.042893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 958/1896] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:55.051040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.051325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.051602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.071017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:55.072225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:55.080451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 959/1897] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:55.084377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.085818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59d13c729564f86902cfd29aa9b8ffc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:55.093108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1c128-7ea9-4318-ab70-eeab33599470 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.098938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.099395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-3c85fe01-ecdf-4a77-bbb0-921464de503a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59d13c729564f86902cfd29aa9b8ffc'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:55.099571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.099816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.100090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.100735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:55.104210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.105898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.106980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 939/1898] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:54 2022] DELETE /identity/v3/users/e59d13c729564f86902cfd29aa9b8ffc => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:55.113614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.113907 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.114206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.122221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 960/1899] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:42:55.126557 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.136003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:55.144940 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7c385-f94e-4107-b4c7-5d5764b54a4e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.145347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:55.208058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.208746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.209042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.209328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.210009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.212199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.226677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 940/1900] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:55.233526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.235018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:55.310419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f17bf-5e00-4b0d-a5a7-1cc5a4fb374e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.318063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.318679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.318908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.319654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.334206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.336272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.338813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 961/1901] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:55.343138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.355476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 941/1902] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:55.425455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3f7a-6ae7-4c2f-9d8e-58b58876ec98 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.435061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.436447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.436589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.436826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.437680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.439989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.573072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 962/1903] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/users => generated 288 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:55.577614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.588216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a01c77-11a2-405a-95da-910b7259d53b service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.594170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.594836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.595358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.595358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.596012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.598805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.611529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 942/1904] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:55.619577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.635536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653677d-4ad0-4b44-af24-1d04b08c9425 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.641625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.641976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.642381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.642667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.644046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.646572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d16053-290e-40d0-b4c8-1e0ac7a4be1a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.662281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 963/1905] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:55.665046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.675386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd2950-ac1e-44ed-997e-32b3774b782f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:55.680386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:55.681049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.681595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.682949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] PATH_INFO: `/v3/projects/35ab4cbf19f9440ca088403b598580e4/users/27f27821904c49ebab00a0c305a9c591/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.687588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:55.699542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ab4cbf19f9440ca088403b598580e4, user_id=27f27821904c49ebab00a0c305a9c591, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:55.702572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:55.812188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 943/1906] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:55 2022] PUT /identity/v3/projects/35ab4cbf19f9440ca088403b598580e4/users/27f27821904c49ebab00a0c305a9c591/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:55.823785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:55.824117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:55.824386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:55.856587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] MFA Rules not processed for user `27f27821904c49ebab00a0c305a9c591`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:55.857848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:55.919898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:55.936144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 964/1907] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:55.940769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.959533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:55.961048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.040298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1f76c-91c6-4c79-9c47-aa9cc114e4d1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.046635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.047479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.047761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.048043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.048826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.051236 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.061145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8869-12b9-4369-971b-cb4e2d8aaec1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.066799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.067745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.068218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.068492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] PATH_INFO: `/v3/projects/1376ca01fcc44248b5cdffc9395d528f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.070395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1376ca01fcc44248b5cdffc9395d528f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.072316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.151627 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 944/1908] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:55 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:56.154395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.191590 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1376ca01fcc44248b5cdffc9395d528f', 'request_id': 'req-0974353a-fba7-45dd-8528-01e95a2ba28c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.199932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1376ca01fcc44248b5cdffc9395d528f', 'request_id': 'req-0974353a-fba7-45dd-8528-01e95a2ba28c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.221092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9a77ea-dfcf-416b-b478-67cde04ab95b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.276873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.277517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.277797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.278068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.278693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.280616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.302296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1376ca01fcc44248b5cdffc9395d528f', 'request_id': 'req-0974353a-fba7-45dd-8528-01e95a2ba28c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.315754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] The token cache is being invalidate because project 1376ca01fcc44248b5cdffc9395d528f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:56.316128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.316875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.319033 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 965/1909] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:55 2022] DELETE /identity/v3/projects/1376ca01fcc44248b5cdffc9395d528f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:56.322369 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.324946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.339235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0974353a-fba7-45dd-8528-01e95a2ba28c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.344077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.344855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.345197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.345448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] PATH_INFO: `/v3/users/560a7f716e684a4f86465c0d78c81358` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.346591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560a7f716e684a4f86465c0d78c81358)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.348616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.389301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 945/1910] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:56 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:56.393375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.394932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.406375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2b85-965c-43c5-bfff-5d1806cde7ae admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.411237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.412065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.412878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.413229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.413905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.415710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.426321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 946/1911] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:42:56.430480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.440731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8a7163-001e-4b77-895a-f0c0732aa43b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.445804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.449141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.449141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.449141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] PATH_INFO: `/v3/projects/bc20083650f54889918ea0ce84df8bc0/users/e8d6add5e2124b2db0a795f8c5a4d3f5/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.462601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc20083650f54889918ea0ce84df8bc0, user_id=e8d6add5e2124b2db0a795f8c5a4d3f5, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.465418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.609390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560a7f716e684a4f86465c0d78c81358'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.622581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560a7f716e684a4f86465c0d78c81358'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.624725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 947/1912] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:56 2022] PUT /identity/v3/projects/bc20083650f54889918ea0ce84df8bc0/users/e8d6add5e2124b2db0a795f8c5a4d3f5/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:56.629275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.643834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560a7f716e684a4f86465c0d78c81358'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.644680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560a7f716e684a4f86465c0d78c81358'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.695802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9272bead-5834-4c51-b180-e6d298488d06 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.700771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.701553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.701836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.702397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.703054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.704700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.715343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 948/1913] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:56.719680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.721507 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.736602 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a29b4f-60f1-4ec5-ad99-8cc3c5fe243a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.739094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-5d73d9d3-6258-4200-ad97-4255dd4fbe33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560a7f716e684a4f86465c0d78c81358'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:56.743008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.743969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.744554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.744847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] PATH_INFO: `/v3/projects/bc20083650f54889918ea0ce84df8bc0/users/e8d6add5e2124b2db0a795f8c5a4d3f5/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.747024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc20083650f54889918ea0ce84df8bc0, user_id=e8d6add5e2124b2db0a795f8c5a4d3f5, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:56.749699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 966/1914] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:56 2022] DELETE /identity/v3/users/560a7f716e684a4f86465c0d78c81358 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:56.762958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:56.792458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 949/1915] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:56 2022] PUT /identity/v3/projects/bc20083650f54889918ea0ce84df8bc0/users/e8d6add5e2124b2db0a795f8c5a4d3f5/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:42:56.803453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.804015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.804437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:56.837463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] MFA Rules not processed for user `e8d6add5e2124b2db0a795f8c5a4d3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:56.838745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.912754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 967/1916] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:56.923842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:56.925787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:56.959553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:56.993760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb940291-7675-4a3e-9c03-f8669cd7c07f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:56.998324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:56.999050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:56.999402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:56.999751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.001821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:57.083105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:57.084778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c583bcb4-bdbf-46dc-acd5-7e16f436e208 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:57.096885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 950/1917] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:57.303835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:57.346632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:57.348121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:57.455798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b368e7-73ee-4e30-9384-b420b05729c8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:57.455995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:57.456723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:57.457071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:57.457460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] PATH_INFO: `/v3/projects/2f015fd06d1f43df9bf2f45987b03b20` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.458688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f015fd06d1f43df9bf2f45987b03b20)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:57.460739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:57.584981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f015fd06d1f43df9bf2f45987b03b20', 'request_id': 'req-82fd4308-fce5-48ba-b168-7ee4522294df'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:57.592192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f015fd06d1f43df9bf2f45987b03b20', 'request_id': 'req-82fd4308-fce5-48ba-b168-7ee4522294df'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:57.675103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f015fd06d1f43df9bf2f45987b03b20', 'request_id': 'req-82fd4308-fce5-48ba-b168-7ee4522294df'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:57.687003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] The token cache is being invalidate because project 2f015fd06d1f43df9bf2f45987b03b20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:42:57.687296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:57.688062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-82fd4308-fce5-48ba-b168-7ee4522294df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:57.689857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 968/1918] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:42:57 2022] DELETE /identity/v3/projects/2f015fd06d1f43df9bf2f45987b03b20 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:57.695547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:57.695862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:57.698171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.717000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:57.718176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:57.783239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 951/1919] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:57.791645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:57.791934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:57.792211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.813154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:57.814388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:57.823236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 969/1920] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:57.827791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:57.840295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af133cd9-b51a-4a8c-870e-fe4f9ade9b18 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:57.847342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:57.847957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:57.848235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:57.848506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.849190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:42:57.849502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:57.851086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:57.863718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 952/1921] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:42:57.868300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:57.878060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cd0e3-5ea8-4511-8c7e-e48341b40dec None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:57.882986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:57.883709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:57.883995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:57.884262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:57.884911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:57.886822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e743a2-ad2b-48ae-a41b-2b745624a8f4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:57.986710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 970/1922] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:57 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:57.990449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.003520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77776-7d8e-4bb4-8158-6863758cce1b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.072554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.073193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.073474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.073746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.074374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.076280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.120621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.120914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.121225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.142305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] MFA Rules not processed for user `56392b5a93bb44c2a859f3751902772e`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:58.144030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:58.199738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 971/1923] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:58.201415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 953/1924] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:57 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:42:58.206219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.216820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d1ebc-6869-40f3-9eeb-e547d5db0f0c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.222068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.222673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.222953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.223255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.223899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.225534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.235481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 972/1925] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:58.245901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.261367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4898e12b-b1c9-4e90-862c-929116e60d9c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.267220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.268958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.268958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.268958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.269606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.271218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c78c5f7-a701-4ee2-aa95-b488a815bd37 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.283497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 954/1926] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:58.284739 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:58.287671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.298739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af905d08-6519-4503-b7f5-e24b2c92ddd5 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.303813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.304745 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.305354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.305354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] PATH_INFO: `/v3/projects/3a5a82685c2d46cca845723cde65d56e/users/fa351fa56cca4773b5b8003cefaeda12/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.332051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5a82685c2d46cca845723cde65d56e, user_id=fa351fa56cca4773b5b8003cefaeda12, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.334870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.384910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 973/1927] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:58 2022] PUT /identity/v3/projects/3a5a82685c2d46cca845723cde65d56e/users/fa351fa56cca4773b5b8003cefaeda12/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:58.397251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.397868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.398163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.432485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] MFA Rules not processed for user `fa351fa56cca4773b5b8003cefaeda12`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:58.433991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:58.530278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 955/1928] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:58.534793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.618339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0ce1ef-4c55-4655-bac2-f30b06c93eb4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.626917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.626917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.626917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.626917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.627474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.629377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.752358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 974/1929] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:42:58 2022] POST /identity/v3/projects => generated 367 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:58.754514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:58.765876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abdb056-27bf-4613-b557-50d855ccb565 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:58.826235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:58.827426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:58.830474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:58.830474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:58.830474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:58.830772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:58.845259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:59.013558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 956/1930] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:42:58 2022] POST /identity/v3/users => generated 290 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:42:59.017669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.032480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2258a-7a24-472d-a84d-104bb790dd68 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.040480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.041780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.041780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.041780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.042837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.045191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.060224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 975/1931] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:59.063681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.080940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90a72f-7969-4480-a329-a923a8b186df admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.095908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.097110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.097388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.097666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] PATH_INFO: `/v3/projects/9e38fb72e18a4bdba3dee66083c10250/users/7720e5ae9e154ff6bca7d4b9789dc87b/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.109697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:59.125202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e38fb72e18a4bdba3dee66083c10250, user_id=7720e5ae9e154ff6bca7d4b9789dc87b, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.126768 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.241117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 957/1932] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:59 2022] PUT /identity/v3/projects/9e38fb72e18a4bdba3dee66083c10250/users/7720e5ae9e154ff6bca7d4b9789dc87b/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:59.243290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.248001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.249705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.256422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bd199-23a9-4bfd-80c7-77f2bbcb6613 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.346184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f749c-f207-4639-a072-9866f3618357 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.347414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.348129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.348413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.348687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.349374 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.351051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.351474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.352107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.352390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.352667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] PATH_INFO: `/v3/users/0b6a49a946c94580bb29369c808ae931` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.353823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6a49a946c94580bb29369c808ae931)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.355781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.364602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 976/1933] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:42:59.364602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.364602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.437276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea324ba0-3a4e-4258-a5ee-311a95b6079f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.442050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.442954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.443403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.443822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.446003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.520339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.521846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.532420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 977/1934] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:42:59.532962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.545358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfaa123-78d9-48d1-a73b-e382df9c6be5 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.554224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.555360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.556348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.556348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] PATH_INFO: `/v3/projects/9e38fb72e18a4bdba3dee66083c10250/users/7720e5ae9e154ff6bca7d4b9789dc87b/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.558975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e38fb72e18a4bdba3dee66083c10250, user_id=7720e5ae9e154ff6bca7d4b9789dc87b, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.562058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cca49-2dcb-4a73-a0e4-7b23a7a906ac admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.582516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 978/1935] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:42:59 2022] PUT /identity/v3/projects/9e38fb72e18a4bdba3dee66083c10250/users/7720e5ae9e154ff6bca7d4b9789dc87b/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:59.590172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6a49a946c94580bb29369c808ae931'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:59.593280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.594773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.595353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.600995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6a49a946c94580bb29369c808ae931'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:59.602072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6a49a946c94580bb29369c808ae931'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:59.640314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] MFA Rules not processed for user `7720e5ae9e154ff6bca7d4b9789dc87b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:59.641694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.716031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 979/1936] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:59 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:42:59.728452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.730044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.755902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6a49a946c94580bb29369c808ae931'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:59.777771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-20e32f77-fda1-43d9-b142-d577e715ece1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6a49a946c94580bb29369c808ae931'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:42:59.787037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 958/1937] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:42:59 2022] DELETE /identity/v3/users/0b6a49a946c94580bb29369c808ae931 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:42:59.792661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.793400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.794350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.808354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336607a5-993f-43f1-b4a7-c252541c61c7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.845748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:42:59.845748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.892189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.892905 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.893792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.894223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:42:59.905879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 959/1938] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:42:59.918384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:42:59.920106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:42:59.959586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:42:59.961324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:42:59.989467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 980/1939] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:42:59.990619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fbf440-e566-4f32-842d-efb4ecea25f6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:42:59.994738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:42:59.995381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:42:59.995715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:42:59.996000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.005590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:00.007025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:00.016477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 960/1940] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:00.120835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:00.223386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:00.241530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cdcf73-34e8-4d3a-97b2-b382480480c2 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:00.245662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:00.246350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.246595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.246803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.250219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:00.339295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:00.340011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:00.351401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 981/1941] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:00.448914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:00.450442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:00.470189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbbe94-70ae-49fe-9fc7-be717cfaeb98 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:00.472782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:00.485574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:00.486632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.486632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.487416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] PATH_INFO: `/v3/projects/3cb6c2ae2d0e49b2b70bcda9b4bb9aa4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.489260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb6c2ae2d0e49b2b70bcda9b4bb9aa4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:00.491782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:00.493711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:00.495642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:00.513570 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140c16c-b3e5-47d4-81a4-abfd4aa905df service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:00.519821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:00.520513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.520796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.521066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] PATH_INFO: `/v3/users/27f27821904c49ebab00a0c305a9c591` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.522242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=27f27821904c49ebab00a0c305a9c591)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:00.524237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:00.684577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27f27821904c49ebab00a0c305a9c591'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.686525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb6c2ae2d0e49b2b70bcda9b4bb9aa4', 'request_id': 'req-5263c662-bb04-4040-8394-37d366c40db6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.692715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb6c2ae2d0e49b2b70bcda9b4bb9aa4', 'request_id': 'req-5263c662-bb04-4040-8394-37d366c40db6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.693962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27f27821904c49ebab00a0c305a9c591'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.699269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb6c2ae2d0e49b2b70bcda9b4bb9aa4', 'request_id': 'req-5263c662-bb04-4040-8394-37d366c40db6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.709004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27f27821904c49ebab00a0c305a9c591'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.709804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27f27821904c49ebab00a0c305a9c591'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.807334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] The token cache is being invalidate because project 3cb6c2ae2d0e49b2b70bcda9b4bb9aa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:00.807732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.808459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-5263c662-bb04-4040-8394-37d366c40db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.810535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 961/1942] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:00 2022] DELETE /identity/v3/projects/3cb6c2ae2d0e49b2b70bcda9b4bb9aa4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:00.815383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911587-5a61-419c-93e5-05532e84ecc1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.815911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911587-5a61-419c-93e5-05532e84ecc1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.816416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911587-5a61-419c-93e5-05532e84ecc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.840664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fa911587-5a61-419c-93e5-05532e84ecc1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:00.841951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fa911587-5a61-419c-93e5-05532e84ecc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:00.899885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0179172f-aedb-4b97-ae2d-631a4a4f8faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27f27821904c49ebab00a0c305a9c591'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:00.908137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 982/1943] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:00 2022] DELETE /identity/v3/users/27f27821904c49ebab00a0c305a9c591 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:00.913164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 962/1944] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:00.913587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.913915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.916909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.920889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:00.921208 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:00.921517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:00.947343 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:00.949409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:00.950309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:00.950600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:01.065253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 983/1945] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:01.068139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 963/1946] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:01.072303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.074913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.077880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:01.084363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e3875-a930-4fe3-82c2-d936a2f594c1 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.089366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.089985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.090420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.090714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.091336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:01.091640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.093287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.106948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 984/1947] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:43:01.111476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.124617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1ffe8-6e57-43a0-9814-70e3778a0165 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.136562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.136562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.136562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.136562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.136968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.136968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.154934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a759b-ae3d-4552-aeb8-88a553b67d77 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.161876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.162511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.163890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.163890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.172994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.175012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.184996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 964/1948] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:01.246813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 985/1949] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:01 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:43:01.247933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.260327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee00db-9a7e-4668-9a2d-40ec52051eb1 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.319711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.320359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.320639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.320910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.321723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.323654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.355723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:01.403111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 965/1950] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:01 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:43:01.416325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.428166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93c819-02ac-417c-9d32-aae45a68ce3d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.433482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.434219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.434507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.434785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.435473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.437172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.447319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 986/1951] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:01.451354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.461737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9580-2d63-4480-83f5-340803ccc5fc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.462498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:01.466698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.470788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.470788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.470788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.470788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.470788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.484608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 966/1952] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:01.485867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.496558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bca5ff1-b1fb-4762-83da-b1bbf69c9c96 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.501300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.501967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.502245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.502519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] PATH_INFO: `/v3/projects/6f7cde9db0f34d17b08efada1d7da482/users/096944bb1ed8463cb423fc6a3581497b/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.517522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f7cde9db0f34d17b08efada1d7da482, user_id=096944bb1ed8463cb423fc6a3581497b, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.521191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92633c4c-00b7-4804-9e63-56bbd8ea6858 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.606455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.613929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 987/1953] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:01 2022] PUT /identity/v3/projects/6f7cde9db0f34d17b08efada1d7da482/users/096944bb1ed8463cb423fc6a3581497b/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:01.614200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:01.622396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b1b97-edd9-42e3-baad-1ea5154e08fc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.622540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.622769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.623122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.654671 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] MFA Rules not processed for user `096944bb1ed8463cb423fc6a3581497b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:01.657382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:01.683299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.683856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.684134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.684411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] PATH_INFO: `/v3/projects/35ab4cbf19f9440ca088403b598580e4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.685640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ab4cbf19f9440ca088403b598580e4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.687501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.723710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 988/1954] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:01.735579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.736982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:01.794958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686298a9-89bf-4f34-a000-ff97da32e3f7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:01.799217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:01.799866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:01.800197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:01.800617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:01.809506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:01.811043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:01.813112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ab4cbf19f9440ca088403b598580e4', 'request_id': 'req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:01.818757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ab4cbf19f9440ca088403b598580e4', 'request_id': 'req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:01.820112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 989/1955] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:01.825822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ab4cbf19f9440ca088403b598580e4', 'request_id': 'req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:01.944129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] The token cache is being invalidate because project 35ab4cbf19f9440ca088403b598580e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:01.949776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:01.949776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:01.949776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 967/1956] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:01 2022] DELETE /identity/v3/projects/35ab4cbf19f9440ca088403b598580e4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:01.951189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:01.963500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c172-0d1f-4088-b468-aba38e8c0165 service glance] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:02.044064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:02.051251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:02.058736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:02.060161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:02.060462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:02.060858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] PATH_INFO: `/v3/users/e8d6add5e2124b2db0a795f8c5a4d3f5` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:02.062383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8d6add5e2124b2db0a795f8c5a4d3f5)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:02.064797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:02.279451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8d6add5e2124b2db0a795f8c5a4d3f5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:02.294046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8d6add5e2124b2db0a795f8c5a4d3f5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:02.314563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8d6add5e2124b2db0a795f8c5a4d3f5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:02.315894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8d6add5e2124b2db0a795f8c5a4d3f5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:02.325826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:02.395168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-562bf712-711a-456c-999b-7a2ac3573b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8d6add5e2124b2db0a795f8c5a4d3f5'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:02.409220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 990/1957] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:01 2022] DELETE /identity/v3/users/e8d6add5e2124b2db0a795f8c5a4d3f5 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:02.628975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:03.284595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:03.286151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:03.307878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0e4cc1-3d4b-41db-b70d-2ec9fef2df41 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:03.497386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:03.498053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:03.498852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:03.499540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] PATH_INFO: `/v3/projects/bc20083650f54889918ea0ce84df8bc0` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:03.500293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc20083650f54889918ea0ce84df8bc0)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:03.502415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:03.516159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:03.669750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc20083650f54889918ea0ce84df8bc0', 'request_id': 'req-bbd852e4-932a-4267-9ece-730838cf39b5'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:03.675416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc20083650f54889918ea0ce84df8bc0', 'request_id': 'req-bbd852e4-932a-4267-9ece-730838cf39b5'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:03.682061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc20083650f54889918ea0ce84df8bc0', 'request_id': 'req-bbd852e4-932a-4267-9ece-730838cf39b5'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:03.778922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] The token cache is being invalidate because project bc20083650f54889918ea0ce84df8bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:03.779305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:03.779998 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bbd852e4-932a-4267-9ece-730838cf39b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:03.782827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 968/1958] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:03 2022] DELETE /identity/v3/projects/bc20083650f54889918ea0ce84df8bc0 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:03.788182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:03.788714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:03.788714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:03.811746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:03.812932 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:03.860632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:03.892187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 991/1959] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:03.900108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:03.900430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:03.900709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:03.938889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:03.940875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:03.968487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 969/1960] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:03.973411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:03.984036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf45e4-bdd3-41fe-97e1-0f8376613db9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:03.994252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:03.995260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:03.995844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.001379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.001379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:04.001379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.001379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.018472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 992/1961] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:43:04.023150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.033250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b2701-edbc-442e-83aa-edc7ae2a3377 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:04.042436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:04.043068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.043355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.043961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.044616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.047336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.158043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 970/1962] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:04 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:04.162601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.185251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc221-691d-4053-9e08-0c4726bc12f1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:04.262361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:04.262361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.262361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.262361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.263793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.265318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.410063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 993/1963] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:04 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:04.415928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.457463 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ba26b-e887-4eed-8039-55e1318f470c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:04.463006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:04.464632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.464632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.464632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.464957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.466523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.479457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 971/1964] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:04.483566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.495876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29910c1d-5351-422e-8a49-2d3bbd2a2583 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:04.509603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:04.510328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.510712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.511056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.511799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.514352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd905af0-fd37-44f6-9215-3e2b0de96dce admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.529785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 994/1965] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:04.535298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.547820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46390441-5c72-4c37-a29b-77b5e7bd14f8 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:04.553488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:04.554365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.554724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.555092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] PATH_INFO: `/v3/projects/a0e4e19711c543c0bd5890e4a4d97906/users/ee9799b3e66b4bf0be18ced9de469315/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.577074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e4e19711c543c0bd5890e4a4d97906, user_id=ee9799b3e66b4bf0be18ced9de469315, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:04.580200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:04.676142 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 972/1966] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:04 2022] PUT /identity/v3/projects/a0e4e19711c543c0bd5890e4a4d97906/users/ee9799b3e66b4bf0be18ced9de469315/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:04.687392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:04.691565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:04.691565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:04.765281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] MFA Rules not processed for user `ee9799b3e66b4bf0be18ced9de469315`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:04.769668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:04.873566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 995/1967] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:04.883543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:04.885499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:05.024005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3063f-b7dc-4ce7-86c8-73d3ae075c0c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:05.028310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:05.029377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:05.030068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:05.030665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:05.041542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:05.043015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b12ef2a-7475-454c-9854-643613d78f4c service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:05.053685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 973/1968] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:07.736975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:07.739569 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:07.782540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:07.813914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbad49-98d6-4393-9d7e-3dfd033ccd1f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:07.819030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:07.819690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:07.819971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:07.820240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] PATH_INFO: `/v3/users/fa351fa56cca4773b5b8003cefaeda12` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:07.822157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa351fa56cca4773b5b8003cefaeda12)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:07.824142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:08.031854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa351fa56cca4773b5b8003cefaeda12'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:08.038432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa351fa56cca4773b5b8003cefaeda12'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:08.052647 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa351fa56cca4773b5b8003cefaeda12'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:08.054809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa351fa56cca4773b5b8003cefaeda12'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:08.189169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa351fa56cca4773b5b8003cefaeda12'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:08.197100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 996/1969] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:07 2022] DELETE /identity/v3/users/fa351fa56cca4773b5b8003cefaeda12 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:08.201535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:08.202023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:08.202115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:08.222075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:08.223381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:08.258233 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:08.285090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 974/1970] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:08.296490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:08.298074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:08.372845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f1e58-72df-458a-b4a6-549aeff54cc1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:08.378962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:08.379743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:08.380027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:08.380300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:08.397283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:08.398808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478bc0a4-4ea2-4b4d-88d0-c7a469e0a3b9 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:08.411233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 997/1971] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:08.985456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:08.986973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:08.999496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1f37-0a20-4ce6-80d3-ff2320e161cd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:09.005784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:09.006524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.007026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.007205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] PATH_INFO: `/v3/projects/3a5a82685c2d46cca845723cde65d56e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.008486 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5a82685c2d46cca845723cde65d56e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:09.012153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:09.060301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.060773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.061077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.082458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:09.083714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:09.134595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:09.135980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5a82685c2d46cca845723cde65d56e', 'request_id': 'req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.142538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 998/1972] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:43:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:09.148101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5a82685c2d46cca845723cde65d56e', 'request_id': 'req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.156938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5a82685c2d46cca845723cde65d56e', 'request_id': 'req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.190398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:09.192347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:09.229555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] The token cache is being invalidate because project 3a5a82685c2d46cca845723cde65d56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:09.230013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.230588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.232291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 975/1973] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:08 2022] DELETE /identity/v3/projects/3a5a82685c2d46cca845723cde65d56e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:09.236091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:09.238069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:09.266382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7043ef7-7427-4d10-b844-c49d7862bd04 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:09.310258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4b65a-bd1b-4912-96cd-11d84d3ed119 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:09.314978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:09.316313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.316623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.316895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] PATH_INFO: `/v3/users/7720e5ae9e154ff6bca7d4b9789dc87b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.318097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7720e5ae9e154ff6bca7d4b9789dc87b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:09.320833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:09.331479 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:09.332119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.332458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.332680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.334572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:09.404575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:09.404575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:09.410129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 999/1974] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:43:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:43:09.416502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:09.417934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:09.431686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26290c73-6c37-405d-949a-13b4c71781c3 service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:09.447796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:09.449031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.450205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.450925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] PATH_INFO: `/v3/users/ee9799b3e66b4bf0be18ced9de469315` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.453297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee9799b3e66b4bf0be18ced9de469315)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:09.458503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:09.563968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7720e5ae9e154ff6bca7d4b9789dc87b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.583237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7720e5ae9e154ff6bca7d4b9789dc87b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.584164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7720e5ae9e154ff6bca7d4b9789dc87b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.648185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:09.658362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7720e5ae9e154ff6bca7d4b9789dc87b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.660107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:09.670776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee9799b3e66b4bf0be18ced9de469315'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.686524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-49154984-1b4c-4952-84e9-47a7d1c3b82f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7720e5ae9e154ff6bca7d4b9789dc87b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.689357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee9799b3e66b4bf0be18ced9de469315'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.704071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 976/1975] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:09 2022] DELETE /identity/v3/users/7720e5ae9e154ff6bca7d4b9789dc87b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:09.749927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee9799b3e66b4bf0be18ced9de469315'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.751192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee9799b3e66b4bf0be18ced9de469315'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.853732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee9799b3e66b4bf0be18ced9de469315'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:09.867849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1000/1976] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:09 2022] DELETE /identity/v3/users/ee9799b3e66b4bf0be18ced9de469315 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:09.888808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:09.889297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:09.891283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:09.973014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:09.978718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:10.127325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 977/1977] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:10.283307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:10.285534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:10.443514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80f84-e79b-41fc-a0a9-74e4a2c4720f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:10.448322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:10.448956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:10.449390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:10.449670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:10.464857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:10.467805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:10.481101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1001/1978] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:10.940700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:10.940700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:10.985836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f30d1d-0ff4-4c2e-9617-1ca96c9426c6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:11.001057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:11.001517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.001806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.002086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] PATH_INFO: `/v3/projects/9e38fb72e18a4bdba3dee66083c10250` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.004624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e38fb72e18a4bdba3dee66083c10250)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:11.006684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:11.216933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e38fb72e18a4bdba3dee66083c10250', 'request_id': 'req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.222982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e38fb72e18a4bdba3dee66083c10250', 'request_id': 'req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.234493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e38fb72e18a4bdba3dee66083c10250', 'request_id': 'req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.310192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:11.320089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:11.351469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] The token cache is being invalidate because project 9e38fb72e18a4bdba3dee66083c10250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:11.352732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.354577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c977e1e8-de79-4f17-ab3a-2cffdb4482ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.357612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 978/1979] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:10 2022] DELETE /identity/v3/projects/9e38fb72e18a4bdba3dee66083c10250 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:11.363464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c532-7bde-41eb-b7f2-18475cfc9421 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.363854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c532-7bde-41eb-b7f2-18475cfc9421 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.364317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1223c532-7bde-41eb-b7f2-18475cfc9421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.375357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd188b6d-e43e-4f7b-a204-cd638b900578 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:11.419867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1223c532-7bde-41eb-b7f2-18475cfc9421 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:11.423034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1223c532-7bde-41eb-b7f2-18475cfc9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:11.563382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:11.564049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.564324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.564610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] PATH_INFO: `/v3/projects/a0e4e19711c543c0bd5890e4a4d97906` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.570682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e4e19711c543c0bd5890e4a4d97906)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:11.572648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:11.642139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 979/1980] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:11.652840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.652840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.652840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.668193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:11.690565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:11.692289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:11.704927 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 980/1981] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:11.709856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:11.721412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e659d-cae4-4346-9b50-641a10984d2e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:11.727784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:11.728526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.728812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.729082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.733154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:11.733448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:11.735048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:11.753711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 981/1982] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:43:11.754641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:11.764954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955d35c-ee12-4cdb-a052-95f4d2af5b69 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:11.776618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e4e19711c543c0bd5890e4a4d97906', 'request_id': 'req-c89aac41-c144-492c-8203-a84db8bf22c7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.788333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e4e19711c543c0bd5890e4a4d97906', 'request_id': 'req-c89aac41-c144-492c-8203-a84db8bf22c7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.862106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e4e19711c543c0bd5890e4a4d97906', 'request_id': 'req-c89aac41-c144-492c-8203-a84db8bf22c7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.863627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:11.875565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] The token cache is being invalidate because project a0e4e19711c543c0bd5890e4a4d97906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:11.876930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.878620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c89aac41-c144-492c-8203-a84db8bf22c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:11.884783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1002/1983] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:11 2022] DELETE /identity/v3/projects/a0e4e19711c543c0bd5890e4a4d97906 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:11.884947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:11.884947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.884947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.884947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.885337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:11.886546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216b228-2ccd-4c2d-be40-1a0fff91fa68 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.886824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216b228-2ccd-4c2d-be40-1a0fff91fa68 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.887089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216b228-2ccd-4c2d-be40-1a0fff91fa68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.892618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:11.919894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a216b228-2ccd-4c2d-be40-1a0fff91fa68 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:11.921212 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a216b228-2ccd-4c2d-be40-1a0fff91fa68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:11.935750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1003/1984] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:11.937436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.937764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.938045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.963058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:11.964320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:11.973087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1004/1985] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:11.977962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:11.988986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd5b1a8-a12f-4209-adf8-e7aca6ac7c08 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:11.994593 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:11.995269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:11.995551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:11.995827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:11.996482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:11.996797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:11.998431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.017178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1005/1986] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:43:12.021380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.027559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 982/1987] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:11 2022] POST /identity/v3/projects => generated 363 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:12.033359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.039073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:12.049701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119f1aa-1b7d-43d9-8867-e4444e0a4fc6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.256251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ce1e4-e1bf-4d11-904e-0a6e3e5a3793 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.262370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.263014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.263297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.263567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.264207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.266191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.266325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.267228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.267729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.268253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.269947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.272326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.358866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 983/1988] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:12 2022] POST /identity/v3/users => generated 282 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:12.361813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.376885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f0704-4e0d-4cc0-9cd5-0af4785ac0f6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.396034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.401418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1006/1989] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:12 2022] POST /identity/v3/projects => generated 371 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:12.402497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.402801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.403533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.407284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.408287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.410912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.433188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 984/1990] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:43:12.435447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.456875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec79f3-5205-4554-b797-118120afd7b8 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.541193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e0ecc-cad4-48e4-a272-3cb80a996055 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.547825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.548864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.549251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.549607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.550390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.552423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.556487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.557174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.557479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.558840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.559521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.563796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.581788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 985/1991] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:12.583064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.598782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439282-4e6e-4230-994a-4d6c1187827d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.604230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.604979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.605292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.605568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] PATH_INFO: `/v3/projects/0f2d89edda9340aaa168e1ca0ddeb8f3/users/82aa85639d504c80b4c1183ab874d4be/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.637811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2d89edda9340aaa168e1ca0ddeb8f3, user_id=82aa85639d504c80b4c1183ab874d4be, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.640634 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0673d33-0b90-4f96-8106-8568dbf7d05a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.690195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1007/1992] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:12 2022] POST /identity/v3/users => generated 286 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:12.694772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.716958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd8125-da10-4e2f-8427-e6265f16d93c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.726349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.727517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.727805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.728081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.729357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.735904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.739294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 986/1993] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:12 2022] PUT /identity/v3/projects/0f2d89edda9340aaa168e1ca0ddeb8f3/users/82aa85639d504c80b4c1183ab874d4be/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:12.747070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1008/1994] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:12.751572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.751751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.752055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.752525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.775055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a80690-f94f-470d-870f-a8b347411f1e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.815666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] MFA Rules not processed for user `82aa85639d504c80b4c1183ab874d4be`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:12.816512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:12.866708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.867956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.868434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.868917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.870124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.872063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.891559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1009/1995] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:12.894083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.908322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73230cc2-38d6-45fd-b263-2256e7dbdd4f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:12.916753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:12.917803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:12.918232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:12.918645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] PATH_INFO: `/v3/projects/e56bcfd8494b46feaa1090a81688c2ef/users/3712ed5f60d14be2a5ab0330fdec0d4e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:12.951501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e56bcfd8494b46feaa1090a81688c2ef, user_id=3712ed5f60d14be2a5ab0330fdec0d4e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:12.958209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774b496-3729-4b0e-9fb3-68d5509f306c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:12.975771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 987/1996] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:12.982726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:12.989426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:13.058344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1010/1997] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:12 2022] PUT /identity/v3/projects/e56bcfd8494b46feaa1090a81688c2ef/users/3712ed5f60d14be2a5ab0330fdec0d4e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:13.063544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:13.063834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:13.064169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:13.108272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:13.110039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:13.147649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:13.152733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c6d4-d74a-441f-b7fc-46745863a657 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:13.211706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:13.229520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:13.230367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:13.230745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:13.231222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:13.277449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1011/1998] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:13.290607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:13.295125 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:13.406940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:13.408426 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc304685-5b91-4a61-82e5-5686ce7c1a44 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:13.417478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:13.427810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 988/1999] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:13.451881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacb87-dc9a-4d7e-babf-277f8634f94b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:13.457058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:13.457785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:13.458141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:13.458641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:13.480360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:13.482208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:13.509046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1012/2000] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:15.768418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31a6b-5583-463a-836d-3d2cea0d324f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:15.773718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31a6b-5583-463a-836d-3d2cea0d324f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:15.773718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e31a6b-5583-463a-836d-3d2cea0d324f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:15.809491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-57e31a6b-5583-463a-836d-3d2cea0d324f None None] MFA Rules not processed for user `3712ed5f60d14be2a5ab0330fdec0d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:15.810918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-57e31a6b-5583-463a-836d-3d2cea0d324f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:15.915438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 989/2001] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:15.927535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:15.939967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369cec0-05f5-4d60-b7c4-02a5260d4419 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:15.945472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:15.946357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:15.948344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:15.948831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:15.962559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:15.964410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4630bc-88d5-42b3-918e-e56247b21a30 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:15.988300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1013/2002] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:18.081018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:18.082171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:18.082171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:18.118718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] MFA Rules not processed for user `3712ed5f60d14be2a5ab0330fdec0d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:18.119976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:18.153816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 990/2003] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:25.970737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:28.105292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=53 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:28.745446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:28.746311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:28.746806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:28.777205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] MFA Rules not processed for user `1ac2e3720a324751bacef35327cc089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:28.777205 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:28.863995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1014/2004] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:30.334723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:30.336601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:30.353756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39517acf-24e9-4905-9eae-7a7c5d491df2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:30.359316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:30.360396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:30.361174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:30.361860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] PATH_INFO: `/v3/users/5265eb540bc34f44b53def5cf8badbbf` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:30.364405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5265eb540bc34f44b53def5cf8badbbf)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:30.366383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:30.583245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5265eb540bc34f44b53def5cf8badbbf'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:30.591461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5265eb540bc34f44b53def5cf8badbbf'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:30.592245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5265eb540bc34f44b53def5cf8badbbf'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:30.698397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5265eb540bc34f44b53def5cf8badbbf'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:30.711804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5265eb540bc34f44b53def5cf8badbbf'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:30.717826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 991/2005] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:30 2022] DELETE /identity/v3/users/5265eb540bc34f44b53def5cf8badbbf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:30.996638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:31.011638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084c9c8-a9d7-4cd1-862d-3a42126c9f79 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:31.078724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:31.081101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:31.101974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:31.103899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:31.104161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:31.104441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] PATH_INFO: `/v3/projects/b85a0f2f3acf481da0898dfdbf87d5da` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:31.106666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85a0f2f3acf481da0898dfdbf87d5da)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:31.109802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:31.159731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10027b-2539-43fc-8a61-1fbc7edd9e3e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:31.165300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:31.168421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:31.168421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:31.168421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] PATH_INFO: `/v3/users/096944bb1ed8463cb423fc6a3581497b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:31.168421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=096944bb1ed8463cb423fc6a3581497b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:31.169813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:31.243244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85a0f2f3acf481da0898dfdbf87d5da', 'request_id': 'req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.253456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85a0f2f3acf481da0898dfdbf87d5da', 'request_id': 'req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.329387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85a0f2f3acf481da0898dfdbf87d5da', 'request_id': 'req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.346481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] The token cache is being invalidate because project b85a0f2f3acf481da0898dfdbf87d5da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:31.346777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.347444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.349202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1015/2006] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:30 2022] DELETE /identity/v3/projects/b85a0f2f3acf481da0898dfdbf87d5da => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:31.352893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:31.353110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '096944bb1ed8463cb423fc6a3581497b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.354821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:31.363719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '096944bb1ed8463cb423fc6a3581497b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.364562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '096944bb1ed8463cb423fc6a3581497b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.399260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:31.429680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c041ccb-405a-4d4a-aac3-dfbdb91bc8b4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:31.434507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:31.435147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:31.435427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:31.435702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] PATH_INFO: `/v3/users/5062d351c7484839bb7d5be7b1ebb9fb` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:31.436840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5062d351c7484839bb7d5be7b1ebb9fb)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:31.439305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:31.453423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '096944bb1ed8463cb423fc6a3581497b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.463695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:31.468746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-32434cc6-d5a1-41f9-814e-db5a6711c0e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '096944bb1ed8463cb423fc6a3581497b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.476475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 992/2007] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:31 2022] DELETE /identity/v3/users/096944bb1ed8463cb423fc6a3581497b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:31.481501 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:31.482229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:31.482843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:31.504200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:31.506126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:31.575257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 993/2008] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:31.585804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:31.587230 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:31.669698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbb154-dd08-4a00-a295-c13104e30c00 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:31.682216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:31.683497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:31.684370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:31.684651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:31.717988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:31.719693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f867c4-35f5-4fe0-88b4-daae4e688a79 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:31.722722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5062d351c7484839bb7d5be7b1ebb9fb'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.731413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 994/2009] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:31.734615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5062d351c7484839bb7d5be7b1ebb9fb'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.756662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5062d351c7484839bb7d5be7b1ebb9fb'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.756662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5062d351c7484839bb7d5be7b1ebb9fb'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.838877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c7f2a56d-b2fb-4154-9ffb-6401faad6cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5062d351c7484839bb7d5be7b1ebb9fb'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:31.846118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1016/2010] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:31 2022] DELETE /identity/v3/users/5062d351c7484839bb7d5be7b1ebb9fb => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:32.025618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.026013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.026389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.028042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 995/2011] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:43:32.037448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.038545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.038987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.082309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:32.083591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.198076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1017/2012] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:32.211172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:32.213042 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.298928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:32.300748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.305999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8bc6ad-4828-4b34-841d-84d4f21c03d7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:32.311313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:32.312072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.312360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.312639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.333598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:32.335143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:32.352758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 996/2013] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:32.432297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33551dbf-8516-4de5-add9-cad2217e8f12 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:32.437985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:32.438820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.439275 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.439730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] PATH_INFO: `/v3/projects/310e92cbf1a54689af52c2388dff453c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.440948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=310e92cbf1a54689af52c2388dff453c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:32.442951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:32.524464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:32.526154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.557217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f29278-f633-4da5-8470-c8bb241561cc service glance] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:32.562673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:32.563429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.563783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.564131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] PATH_INFO: `/v3/projects/6f7cde9db0f34d17b08efada1d7da482` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.565499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f7cde9db0f34d17b08efada1d7da482)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:32.567799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:32.587816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '310e92cbf1a54689af52c2388dff453c', 'request_id': 'req-7f655c34-d5cd-4050-bc13-447b922ceed6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.595353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '310e92cbf1a54689af52c2388dff453c', 'request_id': 'req-7f655c34-d5cd-4050-bc13-447b922ceed6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.693537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '310e92cbf1a54689af52c2388dff453c', 'request_id': 'req-7f655c34-d5cd-4050-bc13-447b922ceed6'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.705488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] The token cache is being invalidate because project 310e92cbf1a54689af52c2388dff453c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:32.705967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.706702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7f655c34-d5cd-4050-bc13-447b922ceed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.708836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1018/2014] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:32 2022] DELETE /identity/v3/projects/310e92cbf1a54689af52c2388dff453c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:32.711648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f7cde9db0f34d17b08efada1d7da482', 'request_id': 'req-9e934d61-4856-4fce-8390-7c14e1377a46'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.713574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211c84-99e7-420e-991d-41a0cfc94108 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.713953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211c84-99e7-420e-991d-41a0cfc94108 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.714326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d211c84-99e7-420e-991d-41a0cfc94108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.717296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f7cde9db0f34d17b08efada1d7da482', 'request_id': 'req-9e934d61-4856-4fce-8390-7c14e1377a46'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.725812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f7cde9db0f34d17b08efada1d7da482', 'request_id': 'req-9e934d61-4856-4fce-8390-7c14e1377a46'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.737155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0d211c84-99e7-420e-991d-41a0cfc94108 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:32.738415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0d211c84-99e7-420e-991d-41a0cfc94108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.801069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1019/2015] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:32.803143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dda08-0761-466b-8f02-59be925a7684 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.803432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dda08-0761-466b-8f02-59be925a7684 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.803707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18dda08-0761-466b-8f02-59be925a7684 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.804994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1020/2016] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:43:32.809025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.809343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.809620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.825824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] The token cache is being invalidate because project 6f7cde9db0f34d17b08efada1d7da482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:32.826321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.827188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-9e934d61-4856-4fce-8390-7c14e1377a46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:32.834490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:32.834490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.835404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 997/2017] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:32 2022] DELETE /identity/v3/projects/6f7cde9db0f34d17b08efada1d7da482 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:32.840097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.841666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.841666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.870538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1021/2018] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:32.875415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:32.898089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:32.899311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a2d8d-14fa-4fd7-9820-4be9527ba907 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:32.902842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:32.915055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:32.915975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:32.916560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:32.916854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:32.917793 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:32.923356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:32.925919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:32.956786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1022/2019] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:43:32.961088 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:32.985376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078412b1-0757-47c8-b4f4-3d91c034f028 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.000814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.001494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.002277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.002915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.005456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.008101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e647dcb-2eb8-47a6-8b18-4f1b93f99472 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.024411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 998/2020] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:33.047949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.049541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:33.061292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d2b91-265b-41a5-947e-3be36ecd231c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.067141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.067546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.074652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.074652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.076008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.077494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.086144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 999/2021] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:33.135341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1023/2022] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:32 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:33.136066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.164824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b467be-ba55-425e-b826-8e2247c0d484 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.229515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdb442-5765-4c25-bc6a-40c007decdb9 None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.229806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdb442-5765-4c25-bc6a-40c007decdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.230082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdb442-5765-4c25-bc6a-40c007decdb9 None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.231673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1024/2023] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:43:33.239269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.239555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.240404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.262725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:33.264221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:33.283956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.284904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.285516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.301152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.301152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.301152 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.376632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1025/2024] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:33.400372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.400969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:33.417843 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1000/2025] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:33 2022] POST /identity/v3/users => generated 287 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:43:33.419380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.434129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656008e-2a0e-47a8-b036-02f4e229a48a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.441612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.442580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.443012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.454081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.458254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.458254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.491778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1001/2026] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:43:33.493297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.505157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebf932-3dc9-4d23-9e93-981d554f791d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.517780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.518457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.518749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.519028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.519683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.521966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.549450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1002/2027] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:43:33.553173 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.558507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78803e82-ac41-458c-ae5f-a56b32f582d0 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.565920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.566088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c31ad-85f3-4833-a268-2bc09b1b0931 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.566764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.569116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.569116 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.573766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.577560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.577560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.577560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] PATH_INFO: `/v3/projects/3d7680eefda3435eacab569e1dd49294/users/1117faf0d3bf42689118f82d7d967783/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.583020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.585020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f131a-9362-4181-849d-f25876838da1 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.598368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7680eefda3435eacab569e1dd49294, user_id=1117faf0d3bf42689118f82d7d967783, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:33.601540 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:33.602995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1026/2028] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:33.712650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1003/2029] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:33 2022] PUT /identity/v3/projects/3d7680eefda3435eacab569e1dd49294/users/1117faf0d3bf42689118f82d7d967783/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:33.724456 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.724740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.725003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:33.760751 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] MFA Rules not processed for user `1117faf0d3bf42689118f82d7d967783`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:33.765670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:33.869824 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1027/2030] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:33.894612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:33.897222 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:33.985480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4bd04-fe5c-4802-9f76-15e4ec4d81e1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:33.991366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:33.992005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:33.992268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:33.992542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:34.009063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:34.010784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990f66b-52f5-4717-a333-651cf0b488cc service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:34.023129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1004/2031] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:34.053265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:34.056451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:34.150526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c315314-51f5-4c92-8dda-985a2266353f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:34.156478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:34.157811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:34.158451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:34.158451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] PATH_INFO: `/v3/users/1117faf0d3bf42689118f82d7d967783` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:34.159835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1117faf0d3bf42689118f82d7d967783)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:34.161951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:34.326313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:34.394379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1117faf0d3bf42689118f82d7d967783'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:34.401625 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1117faf0d3bf42689118f82d7d967783'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:34.418303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1117faf0d3bf42689118f82d7d967783'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:34.419163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1117faf0d3bf42689118f82d7d967783'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:34.487128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1117faf0d3bf42689118f82d7d967783'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:34.495394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1028/2032] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:34 2022] DELETE /identity/v3/users/1117faf0d3bf42689118f82d7d967783 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:34.500536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:34.500823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:34.501099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:34.525174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:34.526781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:34.609928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1005/2033] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:34.642558 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:34.644930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:34.722320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226081ae-b1bb-4766-84aa-db87c9bd3d57 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:34.726740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:34.727481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:34.727768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:34.728124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:34.740042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:34.740954 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7019c4-9ec6-4efe-bc7f-a18ca3af68c9 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:34.751941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1029/2034] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:35.237897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:35.239400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:35.251610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e11b56-fe82-4281-99c8-23795cdd7e5e None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:35.256826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:35.257624 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.258117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.258406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] PATH_INFO: `/v3/projects/3d7680eefda3435eacab569e1dd49294` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.259550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7680eefda3435eacab569e1dd49294)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:35.261560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:35.396882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7680eefda3435eacab569e1dd49294', 'request_id': 'req-b20f68e2-a71b-41c0-a2c1-708692f594ff'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:35.402477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7680eefda3435eacab569e1dd49294', 'request_id': 'req-b20f68e2-a71b-41c0-a2c1-708692f594ff'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:35.409606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7680eefda3435eacab569e1dd49294', 'request_id': 'req-b20f68e2-a71b-41c0-a2c1-708692f594ff'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:35.493747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] The token cache is being invalidate because project 3d7680eefda3435eacab569e1dd49294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:35.494051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:35.494726 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-b20f68e2-a71b-41c0-a2c1-708692f594ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:35.496650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1006/2035] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:35 2022] DELETE /identity/v3/projects/3d7680eefda3435eacab569e1dd49294 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:35.502240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.504100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.505471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.537611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:35.539463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:35.604286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1030/2036] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:35.612785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.614638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.615093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.635833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:35.637079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:35.645490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1007/2037] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:35.651584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:35.662090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284f113-7929-43a5-b334-1c40afe57457 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:35.666823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:35.667433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.667717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.667995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.668794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:35.669098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:35.670728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:35.683263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1031/2038] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:43:35.687870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:35.700573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ecd5e8-f495-4a69-a28e-d51c8d267324 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:35.708770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:35.709746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.710031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.710331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.711045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:35.713163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:35.847014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1008/2039] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:35.848694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:35.860253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d44c-d22c-4b3f-abdf-6df4b1bcbb8f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:35.893119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:35.939478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:35.940342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:35.940623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:35.940892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:35.941710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:35.943818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:36.028847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1032/2040] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:35 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:43:36.033383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:36.045333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12870b11-8d1e-43d5-989e-2a03bbe53055 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:36.050688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:36.058275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:36.058275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:36.058275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:36.058275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:36.058275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:36.064935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1009/2041] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:36.069709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:36.080644 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbd2db-e770-4923-8b27-f26c52a92a91 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:36.086247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:36.086858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:36.087137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:36.087409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:36.088059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:36.089732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f72e7-4729-4892-bf8f-4ad121a40651 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:36.100831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1033/2042] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:43:36.105144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:36.115742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1ccfc-e587-4151-b684-d0e5d93c34c4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:36.120606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:36.121327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:36.121612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:36.121889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] PATH_INFO: `/v3/projects/f00bb2711a83407e8c467b42fc41e364/users/6ea8684f30c64a2e85e40003758e7035/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:36.134214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:36.138330 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f00bb2711a83407e8c467b42fc41e364, user_id=6ea8684f30c64a2e85e40003758e7035, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:36.141027 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:36.213189 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1010/2043] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:36 2022] PUT /identity/v3/projects/f00bb2711a83407e8c467b42fc41e364/users/6ea8684f30c64a2e85e40003758e7035/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:36.223976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175293d-7159-466e-aa0c-716d178e7a66 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:36.224806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175293d-7159-466e-aa0c-716d178e7a66 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:36.224806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175293d-7159-466e-aa0c-716d178e7a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:36.255555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d175293d-7159-466e-aa0c-716d178e7a66 None None] MFA Rules not processed for user `6ea8684f30c64a2e85e40003758e7035`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:36.256864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d175293d-7159-466e-aa0c-716d178e7a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:36.327485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1034/2044] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:36.338713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:36.340503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:36.408160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c80a87-407b-4d3f-993e-56ddeef33b11 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:36.414395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:36.415008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:36.415290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:36.415566 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:36.424913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:36.426420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:36.436643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1011/2045] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:36.880130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:37.179252 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:37.464222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:41.024482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:41.025030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:41.025199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:41.047799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:41.049153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:41.129234 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1035/2046] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:43:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:41.141902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:41.143494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:41.221007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320772c4-68d4-4d52-acff-23090aa1ce0d service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:41.227050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:41.227717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:41.227993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:41.228260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:41.237018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:41.238639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9b4d6-2654-4b74-8d00-282ca17b0ae2 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:41.248503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1012/2047] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:43:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:43:49.153155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:49.178649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:49.230895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5438fbd-f8ba-4600-b2f2-a7c601b7668a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:49.236718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:49.241876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:49.241876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:49.241876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] PATH_INFO: `/v3/users/6ea8684f30c64a2e85e40003758e7035` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:49.241876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea8684f30c64a2e85e40003758e7035)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:49.241876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:49.522989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea8684f30c64a2e85e40003758e7035'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:49.546256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea8684f30c64a2e85e40003758e7035'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:49.565468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea8684f30c64a2e85e40003758e7035'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:49.566516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea8684f30c64a2e85e40003758e7035'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:49.670674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea8684f30c64a2e85e40003758e7035'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:49.690430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1036/2048] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:49 2022] DELETE /identity/v3/users/6ea8684f30c64a2e85e40003758e7035 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:49.691517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:49.692018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:49.692102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:49.715473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:49.717940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:49.780122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:49.809097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1013/2049] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:49.820351 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:49.822605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:49.901354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158edc18-ae46-4801-8448-87a308b563c4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:49.905007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:49.905672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:49.905950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:49.906221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:49.917193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:49.918715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e145f4-aaea-40cd-bbfe-e0ead6a63ac5 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:49.937553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1037/2050] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:50.421266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:50.422878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:50.442006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4abc2e7-128d-48e3-89b6-5cc6754385a7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:50.448660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:50.449465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:50.449814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:50.450157 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] PATH_INFO: `/v3/projects/f00bb2711a83407e8c467b42fc41e364` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:50.451383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f00bb2711a83407e8c467b42fc41e364)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:50.453522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:50.591206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f00bb2711a83407e8c467b42fc41e364', 'request_id': 'req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:50.599604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f00bb2711a83407e8c467b42fc41e364', 'request_id': 'req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:50.607102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f00bb2711a83407e8c467b42fc41e364', 'request_id': 'req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:50.710174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] The token cache is being invalidate because project f00bb2711a83407e8c467b42fc41e364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:50.710866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:50.711810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:50.713632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1014/2051] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:50 2022] DELETE /identity/v3/projects/f00bb2711a83407e8c467b42fc41e364 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:54.434475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a273d-c873-4c70-8000-8ce0fc304120 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:54.435060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a273d-c873-4c70-8000-8ce0fc304120 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:54.435060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a273d-c873-4c70-8000-8ce0fc304120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:54.456634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1d4a273d-c873-4c70-8000-8ce0fc304120 None None] MFA Rules not processed for user `3712ed5f60d14be2a5ab0330fdec0d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:54.457909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1d4a273d-c873-4c70-8000-8ce0fc304120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:54.501563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:54.518526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1038/2052] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:55.403098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:55.407130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:55.492841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9e830-22d3-44a8-803e-9d22b49b5c2f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:55.498115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:55.498772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:55.499055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:55.499331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] PATH_INFO: `/v3/users/82aa85639d504c80b4c1183ab874d4be` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:55.500686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82aa85639d504c80b4c1183ab874d4be)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:55.502458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:55.747932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82aa85639d504c80b4c1183ab874d4be'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:55.755472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82aa85639d504c80b4c1183ab874d4be'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:55.756198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82aa85639d504c80b4c1183ab874d4be'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:55.829553 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82aa85639d504c80b4c1183ab874d4be'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:55.845937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82aa85639d504c80b4c1183ab874d4be'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:55.848368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:55.855082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1015/2053] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:43:55 2022] DELETE /identity/v3/users/82aa85639d504c80b4c1183ab874d4be => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:43:55.859503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:55.859953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:55.860055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:55.880763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:55.882536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:55.962987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1039/2054] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:55.970055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:55.971824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:56.044090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443767f-04a4-47f0-a08b-3e01f4d1e3c6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:56.051887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:56.052651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:56.052987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:56.053357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:56.064408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:56.066130 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783b172c-ca36-4b37-b037-b8858effa2b7 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:56.077930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1016/2055] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:43:56.469284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:56.470965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:56.487023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18d5098-cc7a-427b-bcdf-51cad9bd84f6 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:56.492194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:56.492873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:56.493183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:56.493463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] PATH_INFO: `/v3/projects/0f2d89edda9340aaa168e1ca0ddeb8f3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:56.494712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2d89edda9340aaa168e1ca0ddeb8f3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:56.497272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:56.658370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2d89edda9340aaa168e1ca0ddeb8f3', 'request_id': 'req-bc2e4f64-6f8d-4774-bc23-fafb1171520e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:56.668338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2d89edda9340aaa168e1ca0ddeb8f3', 'request_id': 'req-bc2e4f64-6f8d-4774-bc23-fafb1171520e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:56.773303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2d89edda9340aaa168e1ca0ddeb8f3', 'request_id': 'req-bc2e4f64-6f8d-4774-bc23-fafb1171520e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:56.793468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] The token cache is being invalidate because project 0f2d89edda9340aaa168e1ca0ddeb8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:43:56.793776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:56.794640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bc2e4f64-6f8d-4774-bc23-fafb1171520e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:43:56.802216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1040/2056] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:43:56 2022] DELETE /identity/v3/projects/0f2d89edda9340aaa168e1ca0ddeb8f3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:56.807320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:56.816267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:56.816267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:56.873785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:56.873785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:56.941809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1017/2057] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:43:56.949770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:56.950225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:56.950332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:56.973299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:56.974542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:56.983359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1041/2058] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:56.987658 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:56.997758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8714-a521-4845-b58d-b9f800a053dd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.002663 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.003267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.003546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.003818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.004460 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:43:57.004764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.006450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.019652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1018/2059] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:43:57.023977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.034104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb18a5-bf1a-4abf-8420-3471b6c24628 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.039059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.039807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.040092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.040372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.041294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.043079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.157023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1042/2060] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:43:57 2022] POST /identity/v3/projects => generated 383 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:43:57.158000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.169076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c810f99-8c9f-4dba-971d-9340c5e64fa5 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.253973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.254584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.254864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.255138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.255772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.257767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.357284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1019/2061] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:43:57 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:43:57.357425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.366458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecda0f-6e27-468d-b0e1-d88cf767a91e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.371773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.372442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.372697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.372989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.373665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.375320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.387029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1043/2062] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:43:57.391278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.401609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcad175-3727-4284-a9dc-a1fe853804e9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.406502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.407168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.407388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.407664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.408315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.409967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d25f41-8c50-421c-b1e0-fc62990db86a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.420990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1020/2063] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:43:57.425013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.435493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565719dd-a221-467f-ad0e-b29b005e8d03 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.440303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.440957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.441289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.441587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] PATH_INFO: `/v3/projects/2001592e21734d6db2386e7dcc97ebe3/users/3c319d0e300b435cbe3177611e414770/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.459001 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2001592e21734d6db2386e7dcc97ebe3, user_id=3c319d0e300b435cbe3177611e414770, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.461791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.533440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1044/2064] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:43:57 2022] PUT /identity/v3/projects/2001592e21734d6db2386e7dcc97ebe3/users/3c319d0e300b435cbe3177611e414770/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:43:57.539269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060acef-509a-4279-8d58-ef48d25e6f8c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.539703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060acef-509a-4279-8d58-ef48d25e6f8c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.539987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060acef-509a-4279-8d58-ef48d25e6f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.554481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:57.561599 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2060acef-509a-4279-8d58-ef48d25e6f8c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:57.563080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2060acef-509a-4279-8d58-ef48d25e6f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:57.625560 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1021/2065] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:57.635761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:57.639670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:57.650328 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:57.697923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9777b-910a-4fe2-a28c-9710d9711ebb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:57.701997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:57.702612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:57.702894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:57.703172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:57.713408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:57.715362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:57.726203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1045/2066] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:43:58.361221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782b0c-c464-4621-965a-89efae0eacba None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:58.361751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782b0c-c464-4621-965a-89efae0eacba None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:58.361751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de782b0c-c464-4621-965a-89efae0eacba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:58.385632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-de782b0c-c464-4621-965a-89efae0eacba None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:58.387545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-de782b0c-c464-4621-965a-89efae0eacba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:58.486508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1022/2067] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:43:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:58.503294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:58.506087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:58.592133 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628dd7-7c8a-4c30-a39f-0ef2945c63ff service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:58.597372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:58.600040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:58.600040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:58.600040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:58.608662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:58.610344 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:58.618901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1046/2068] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:43:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:43:59.251049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac311-87cf-45c5-99aa-bdb1df4551e2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:59.251611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac311-87cf-45c5-99aa-bdb1df4551e2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:59.252044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac311-87cf-45c5-99aa-bdb1df4551e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:59.309146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ee6ac311-87cf-45c5-99aa-bdb1df4551e2 None None] MFA Rules not processed for user `3c319d0e300b435cbe3177611e414770`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:43:59.310539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ee6ac311-87cf-45c5-99aa-bdb1df4551e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:59.401661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1023/2069] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:43:59.412689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:43:59.414531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:43:59.478914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb65d1-5359-4c63-9314-f8338ae5b8c3 service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:43:59.483603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:43:59.484217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:43:59.484492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:43:59.484758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:43:59.493418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:43:59.494875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:43:59.504506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1047/2070] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:43:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:44:01.204572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd330-85b3-48b6-8f9c-423b08796de8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:01.205119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd330-85b3-48b6-8f9c-423b08796de8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:01.205278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fd330-85b3-48b6-8f9c-423b08796de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:01.225283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f95fd330-85b3-48b6-8f9c-423b08796de8 None None] MFA Rules not processed for user `3c319d0e300b435cbe3177611e414770`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:01.226503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f95fd330-85b3-48b6-8f9c-423b08796de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:01.234044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1024/2071] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:09.500426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=80 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:11.220227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:13.765881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:13.767988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:13.840627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a5bedc-d8ac-4f7f-a254-6763fad91131 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:13.846263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:13.846862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:13.847147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:13.847420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:13.851987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:13.861241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:13.862837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:13.874133 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1048/2072] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:44:20.248868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ddd28-9595-4ff8-926a-315c374d62f8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:20.249405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ddd28-9595-4ff8-926a-315c374d62f8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:20.249541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ddd28-9595-4ff8-926a-315c374d62f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:20.271485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-415ddd28-9595-4ff8-926a-315c374d62f8 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:20.273012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-415ddd28-9595-4ff8-926a-315c374d62f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:20.290680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1025/2073] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:44:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:20.315268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:20.339550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4296aed3-7f70-45cd-84d2-430866e089d4 service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:20.345256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:20.346219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:20.346327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:20.346602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:20.356074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:20.358257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac14fb-e973-4223-8fe7-81498ed2739a service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:20.367462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1049/2074] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:44:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:44:23.297077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:23.298329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:23.298616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:23.319714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] MFA Rules not processed for user `56392b5a93bb44c2a859f3751902772e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:23.321209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:23.381809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1026/2075] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:30.363586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=38 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:33.375127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=28 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:43.793353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40b34-1cb5-4fc8-a677-431405800b13 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:43.793831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40b34-1cb5-4fc8-a677-431405800b13 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:43.794041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f40b34-1cb5-4fc8-a677-431405800b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:43.813919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-23f40b34-1cb5-4fc8-a677-431405800b13 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:43.815144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-23f40b34-1cb5-4fc8-a677-431405800b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:43.823020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1050/2076] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:43.840483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:43.841929 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:43.916007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18590-234d-4663-bb7a-b8c71b81d2f5 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:43.921431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:43.922037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:43.922340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:43.922610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:43.930684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:43.932297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:43.941752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1027/2077] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:44:44.632033 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:44.632323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:44.632631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:44.652188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:44.653421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:44.660702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1051/2078] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:44:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:44.673533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:44.685267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dca368-f50c-46f5-9a5d-9a3d1c5dc9f5 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:44.690312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:44.690905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:44.691184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:44.691454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:44.700313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:44.701925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:44.710422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1028/2079] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:44:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:44:48.011656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:48.013265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:48.034406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c325a9-b0de-481a-b8bf-9c9e998bc7f7 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:48.038667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:48.039383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:48.039730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:48.040073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] PATH_INFO: `/v3/users/3712ed5f60d14be2a5ab0330fdec0d4e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:48.043005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3712ed5f60d14be2a5ab0330fdec0d4e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:48.045410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:48.273803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3712ed5f60d14be2a5ab0330fdec0d4e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.289676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3712ed5f60d14be2a5ab0330fdec0d4e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.306941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3712ed5f60d14be2a5ab0330fdec0d4e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.307800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3712ed5f60d14be2a5ab0330fdec0d4e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.382117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-598ecbb9-5798-4056-82bb-6f26cc556ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3712ed5f60d14be2a5ab0330fdec0d4e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.388887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1052/2080] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:44:48 2022] DELETE /identity/v3/users/3712ed5f60d14be2a5ab0330fdec0d4e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:44:48.678020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:48.690456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49e525-62a3-461f-8214-2b9236efda98 service swift] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:48.767625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:48.768270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:48.768549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:48.768848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] PATH_INFO: `/v3/projects/e56bcfd8494b46feaa1090a81688c2ef` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:48.770416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e56bcfd8494b46feaa1090a81688c2ef)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:48.777458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:48.875871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e56bcfd8494b46feaa1090a81688c2ef', 'request_id': 'req-0aacc004-d30c-43d5-8a30-8bb9c491682b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.882564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e56bcfd8494b46feaa1090a81688c2ef', 'request_id': 'req-0aacc004-d30c-43d5-8a30-8bb9c491682b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.889181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e56bcfd8494b46feaa1090a81688c2ef', 'request_id': 'req-0aacc004-d30c-43d5-8a30-8bb9c491682b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.978632 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] The token cache is being invalidate because project e56bcfd8494b46feaa1090a81688c2ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:44:48.979022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.979683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0aacc004-d30c-43d5-8a30-8bb9c491682b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:44:48.981393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1029/2081] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:44:48 2022] DELETE /identity/v3/projects/e56bcfd8494b46feaa1090a81688c2ef => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:44:48.987777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:48.988069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:48.988615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.009631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:49.010866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.072958 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1053/2082] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:49.081210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.081547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.081826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.089674 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:49.102427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:49.103653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.111698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1030/2083] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:49.116478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.127002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b488e46-7bea-4424-98b8-bb5321911f80 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.132421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.133025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.133365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.133638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.134280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:44:49.134580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.136483 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.174809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1054/2084] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:44:49.175010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.183072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed2d62-b6a6-4d5f-a768-b3870fbe9a4f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.188012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.188666 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.188956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.189269 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.189945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.191881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edc4b19-8bda-4758-b72f-9df8e136571f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.389338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1031/2085] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:44:49 2022] POST /identity/v3/projects => generated 371 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:44:49.390655 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.401783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e128411f-3168-4d30-b896-e09f1a9a881c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.448158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:49.463764 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.464395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.464675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.464946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.465687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.467903 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.473322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.473650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.473937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.493622 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:49.496608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.502990 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1032/2086] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:44:49.519243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.521176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.552632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1055/2087] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:44:49 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:44:49.556864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.568500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec1b9-f1ce-4a96-978c-49f40e16d8e9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.577334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.577334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.577334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.577334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.577835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.577835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.605908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1056/2088] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:44:49.605908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.615994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff60e71-95a2-4183-9a06-0340032be0ad admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.619272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1857c7-e4f1-4939-a866-628d0de00279 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.621008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.621690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.621923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.622197 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.622835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.624508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.629022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.630453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.631577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.632211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.637058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1057/2089] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:44:49.642187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.642629 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.644515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301bc7a-c8ae-4d04-9ade-9729a2d5e092 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.653920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0dd92-b76b-4c48-b0c9-aee33d1946f7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.658146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1033/2090] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:44:49.667085 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.667773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.668056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.668333 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] PATH_INFO: `/v3/projects/ca4ef8c793ac4f54b74f967ffd6078b1/users/ebf4be17863247648c2a1f06048cc5c1/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.686750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4ef8c793ac4f54b74f967ffd6078b1, user_id=ebf4be17863247648c2a1f06048cc5c1, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.689969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.769055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1058/2091] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:44:49 2022] PUT /identity/v3/projects/ca4ef8c793ac4f54b74f967ffd6078b1/users/ebf4be17863247648c2a1f06048cc5c1/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:44:49.776128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493ca2-68c3-43f0-981f-1e2c20b787ad None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.776581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493ca2-68c3-43f0-981f-1e2c20b787ad None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.776682 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94493ca2-68c3-43f0-981f-1e2c20b787ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.796536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-94493ca2-68c3-43f0-981f-1e2c20b787ad None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:49.801062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-94493ca2-68c3-43f0-981f-1e2c20b787ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.855626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1034/2092] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:49.865885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:49.867570 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:49.922642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4104b9-f501-48ae-b89b-6209ddef6efc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:49.926305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:49.927432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:49.927709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:49.927979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:49.937607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:49.938961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:49.948916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1059/2093] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:44:55.855281 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998445c-df34-4d1e-b076-4a113f136122 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:55.855833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998445c-df34-4d1e-b076-4a113f136122 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:55.856046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998445c-df34-4d1e-b076-4a113f136122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:55.877980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a998445c-df34-4d1e-b076-4a113f136122 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:55.883187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a998445c-df34-4d1e-b076-4a113f136122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:55.889692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1035/2094] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:55.905781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:56.027893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352577c0-536b-4e96-b72d-5538b96aa794 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:56.034875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:56.035503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:56.035818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:56.036100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:56.054573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:56.058507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:56.106654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1060/2095] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:44:57.323988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.324473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.324557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.357226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] MFA Rules not processed for user `ebf4be17863247648c2a1f06048cc5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:57.358480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:57.394383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:57.436400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1036/2096] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:57.437815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.449247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e8e61-95a5-4d29-a678-d4a015180d68 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.454709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.467748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.467748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.467748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.467748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.467748 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:57.475025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:57.566847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1061/2097] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:44:57 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:44:57.568545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.579709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a804ac8-459b-416a-b47c-e77d3336c88f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.641417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.641963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.642245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.642523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.643172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.645096 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:57.729575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1037/2098] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:44:57 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:44:57.733642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.744429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a12440a-8289-4291-a022-e1119c61a12b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.749089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.749729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.750022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.750561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.750930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.752573 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:57.763967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1062/2099] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:44:57.768186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.778991 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f01cd-dab4-4c10-a54e-5df973da0bd7 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.783638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.784987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.784987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.784987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] PATH_INFO: `/v3/projects/16931758f3a64040b80bfe4e899d7a31/users/63aa87903bcb411a8a1028742ab55566/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.799704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] RBAC: Authorizing `identity:create_grant(project_id=16931758f3a64040b80bfe4e899d7a31, user_id=63aa87903bcb411a8a1028742ab55566, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.802442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:57.861017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1038/2100] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:44:57 2022] PUT /identity/v3/projects/16931758f3a64040b80bfe4e899d7a31/users/63aa87903bcb411a8a1028742ab55566/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:44:57.865348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.875904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c49242-0100-47e1-974c-01f8f46d3d11 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.938471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.939122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.939430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.939703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.940356 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.942079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcaff-c58e-439a-b384-b0a08d9803c8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:57.956750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1063/2101] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:44:57.960917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:57.975150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14372bf3-0a59-4298-ab32-6ef7928a554e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:57.983971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:57.984383 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:57.985090 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:57.985615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] PATH_INFO: `/v3/projects/16931758f3a64040b80bfe4e899d7a31/users/63aa87903bcb411a8a1028742ab55566/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:57.987708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16931758f3a64040b80bfe4e899d7a31, user_id=63aa87903bcb411a8a1028742ab55566, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:57.993445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:44:58.007690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1039/2102] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:44:57 2022] PUT /identity/v3/projects/16931758f3a64040b80bfe4e899d7a31/users/63aa87903bcb411a8a1028742ab55566/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:44:59.713535 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcf4f-824b-4d14-b7e6-1a6e3261ee59 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:59.714034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcf4f-824b-4d14-b7e6-1a6e3261ee59 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:59.714114 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dcf4f-824b-4d14-b7e6-1a6e3261ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:59.749898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-088dcf4f-824b-4d14-b7e6-1a6e3261ee59 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:44:59.754589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-088dcf4f-824b-4d14-b7e6-1a6e3261ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:59.825565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1064/2103] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:44:59.840926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:44:59.842753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:44:59.948694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217eaada-28df-4a4a-8cbe-0ec585d92353 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:44:59.955764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:44:59.956665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:44:59.956941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:44:59.957270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:44:59.983712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:44:59.986504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad19072-bac5-4c41-9297-db355be49bb8 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:00.012304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1040/2104] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:02.568536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:02.569072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:02.569072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:02.590613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] MFA Rules not processed for user `a50d4e2b72a045b0bf1e9afad975e1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:02.591894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:02.664004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1065/2105] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:04.071701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c87d6-30b9-40f3-9f10-5b0448d756ea None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:04.072147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c87d6-30b9-40f3-9f10-5b0448d756ea None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:04.072421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c87d6-30b9-40f3-9f10-5b0448d756ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:04.101079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-441c87d6-30b9-40f3-9f10-5b0448d756ea None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:04.103242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-441c87d6-30b9-40f3-9f10-5b0448d756ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:04.139332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1041/2106] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:04.154227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:04.180549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5677-2723-446b-ad66-2cebf04d65ac None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:04.197280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:04.198062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:04.198504 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:04.198914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:04.221253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:04.223776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:04.255701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1066/2107] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:04.539400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a95b7-c202-49a8-93d3-d5567ecb2825 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:04.539817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a95b7-c202-49a8-93d3-d5567ecb2825 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:04.540307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a95b7-c202-49a8-93d3-d5567ecb2825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:04.561812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:04.585499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-168a95b7-c202-49a8-93d3-d5567ecb2825 None None] MFA Rules not processed for user `63aa87903bcb411a8a1028742ab55566`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:04.586957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-168a95b7-c202-49a8-93d3-d5567ecb2825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:04.699712 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1042/2108] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:04.713397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:04.724506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a701d-4c9e-4ae1-a101-8a325539f33d service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:04.731863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:04.738138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:04.738138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:04.738138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:04.750365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:04.801492 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:04.803730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c6613-a179-4401-a819-871b87cfbbc7 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:04.817868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1067/2109] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:06.973697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb40e-6fda-4a9f-9556-8fdc202a5b0a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:06.974253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb40e-6fda-4a9f-9556-8fdc202a5b0a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:06.974253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ddb40e-6fda-4a9f-9556-8fdc202a5b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:07.000459 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-08ddb40e-6fda-4a9f-9556-8fdc202a5b0a None None] MFA Rules not processed for user `1ac2e3720a324751bacef35327cc089a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:07.002056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-08ddb40e-6fda-4a9f-9556-8fdc202a5b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:07.066341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1043/2110] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:07.425898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:07.425898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:07.425898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:07.442233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] MFA Rules not processed for user `ebf4be17863247648c2a1f06048cc5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:07.444200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:07.451449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1068/2111] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:08.384523 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d8a8-9d10-4fee-b92a-3eb663fa1971 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:08.385470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d8a8-9d10-4fee-b92a-3eb663fa1971 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:08.386143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33d8a8-9d10-4fee-b92a-3eb663fa1971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:08.418340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6e33d8a8-9d10-4fee-b92a-3eb663fa1971 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:08.420172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6e33d8a8-9d10-4fee-b92a-3eb663fa1971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:08.430425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1044/2112] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:08.447888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:08.464193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad80602-2ddf-493d-98a6-9851779957dc None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:08.470688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:08.471646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:08.472106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:08.473104 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:08.484676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:08.486511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:08.500324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1069/2113] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:18.411928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=59 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:18.493876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=31 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:28.970051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ef64-8acc-4910-b1f8-145c8812d8b2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:28.970616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ef64-8acc-4910-b1f8-145c8812d8b2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:28.970616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e2ef64-8acc-4910-b1f8-145c8812d8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:28.991018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b4e2ef64-8acc-4910-b1f8-145c8812d8b2 None None] MFA Rules not processed for user `3c319d0e300b435cbe3177611e414770`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:28.992205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b4e2ef64-8acc-4910-b1f8-145c8812d8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:29.047442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1045/2114] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:39.018216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:39.040736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=25 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:39.073079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6160ab9-94d0-425a-9347-b4ea66b831dc service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:39.077029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:39.077689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:39.077972 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:39.078253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:39.088305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:39.089781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:39.099241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1070/2115] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:45.739490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8da6-ab6b-48ff-994e-d5d9e43e2a9d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:45.740022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8da6-ab6b-48ff-994e-d5d9e43e2a9d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:45.740115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f8da6-ab6b-48ff-994e-d5d9e43e2a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:45.760895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7d1f8da6-ab6b-48ff-994e-d5d9e43e2a9d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:45.762079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7d1f8da6-ab6b-48ff-994e-d5d9e43e2a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:45.770576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1046/2116] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:45.785421 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:45.797392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433d47f-c09a-4431-8644-ee77fd507586 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:45.803291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:45.803871 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:45.804148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:45.804417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:45.812723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:45.814337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:45.824509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1071/2117] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:50.345615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428fb3-34b0-44c1-8ce6-3287863ef5db None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:50.346044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428fb3-34b0-44c1-8ce6-3287863ef5db None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:50.346857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1428fb3-34b0-44c1-8ce6-3287863ef5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:50.366625 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b1428fb3-34b0-44c1-8ce6-3287863ef5db None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:50.367829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b1428fb3-34b0-44c1-8ce6-3287863ef5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:50.375721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1047/2118] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:50.390858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:50.402600 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca089be-8cc8-4a3c-a8d8-7be626d02fe4 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:50.408345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:50.408907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:50.409222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:50.409498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:50.418309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:50.419879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:50.429434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1072/2119] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:53.235294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ee2-1634-4a57-9e4c-8170a7d8f368 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:53.235803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ee2-1634-4a57-9e4c-8170a7d8f368 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:53.236669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e36ee2-1634-4a57-9e4c-8170a7d8f368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:53.257542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-32e36ee2-1634-4a57-9e4c-8170a7d8f368 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:53.258706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-32e36ee2-1634-4a57-9e4c-8170a7d8f368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:53.266720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1048/2120] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:53.283177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:53.294334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f0819-d149-4116-83f1-ab6acd97e763 service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:53.299856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:53.302542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:53.302542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:53.302542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:53.309678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:53.311243 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb162c-fb39-4574-b2ad-378376ccd171 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:53.321605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1073/2121] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:45:54.406828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:54.407336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:54.409545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:54.425983 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] MFA Rules not processed for user `56392b5a93bb44c2a859f3751902772e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:54.427184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:54.482405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1049/2122] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:57.522298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c4ec-168c-4ac1-be67-f0c3952f7a03 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:57.522805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c4ec-168c-4ac1-be67-f0c3952f7a03 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:57.522910 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111c4ec-168c-4ac1-be67-f0c3952f7a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:57.542728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e111c4ec-168c-4ac1-be67-f0c3952f7a03 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:45:57.543918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e111c4ec-168c-4ac1-be67-f0c3952f7a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:45:57.552027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1074/2123] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:45:57.566822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:45:57.580198 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b28b3-60c1-4da8-889f-bd7d638f3ab8 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:45:57.585690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:45:57.586288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:45:57.586568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:45:57.586841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:45:57.594802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:45:57.596378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:45:57.606407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1050/2124] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:03.864355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:03.865148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:03.865667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:03.886797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:03.888063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:03.902722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1075/2125] 10.222.0.46 () {58 vars in 1016 bytes} [Wed Oct 12 12:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:46:03.920862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:03.934128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2d88-844f-4d80-b1c7-c58bdbce44b4 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:03.939847 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:03.945106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:03.945106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:03.945106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:03.950757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:03.952392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:03.962031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1051/2126] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:04.223837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:04.225282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:04.237642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae35df-aa91-49a5-9f7c-415ad1f83e66 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:04.241199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:04.241801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:04.242082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:04.242352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:04.244759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:04.258605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:04.260269 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:04.272811 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1076/2127] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:05.509928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:05.519496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998dd5d-5258-49f0-bf3f-9020f0335cf4 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:05.523195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:05.523778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:05.524054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:05.524327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:05.526055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:05.539064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:05.541053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:05.552177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1052/2128] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:14.267184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=56 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:15.547174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=52 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:16.228113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:16.240132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f22119-ac44-4d5d-b5a1-853f1213179d service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:16.246262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:16.246860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:16.247141 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:16.247417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:16.249178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:16.259377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:16.260952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:16.270005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1077/2129] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:16 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:20.211125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:20.220285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5b26-81fe-429c-a3a2-76d6941b753a service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:20.223953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:20.224545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:20.224831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:20.225107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:20.227041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:20.238794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:20.240249 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3ed28-f955-41e1-a5f4-7747be2c7634 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:20.249972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1053/2130] 10.222.0.50 () {60 vars in 1396 bytes} [Wed Oct 12 12:46:20 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:26.266108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=6 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:26.303615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:26.312912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69016bb6-a27a-4c83-8b18-5abf9bf8920d service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:26.316526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:26.317157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:26.317455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:26.317729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:26.319775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:26.337840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:26.339327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:26.350099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1078/2131] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:29.151914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e975-476d-4d36-8a05-de48034818bd None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:29.152391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e975-476d-4d36-8a05-de48034818bd None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:29.152493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362e975-476d-4d36-8a05-de48034818bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:29.179809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-0362e975-476d-4d36-8a05-de48034818bd None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:29.179809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0362e975-476d-4d36-8a05-de48034818bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:29.253098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1054/2132] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:46:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:29.440755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:29.442261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:29.511663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ce77a-9c68-433e-8ab1-bf4c217054e7 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:29.516762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:29.517397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:29.517684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:29.517957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:29.526118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:29.529567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:29.535757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1079/2133] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:46:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:46:30.532903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e975-476d-4d36-8a05-de48034818bd None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:30.534966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-0362e975-476d-4d36-8a05-de48034818bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:30.555829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362e975-476d-4d36-8a05-de48034818bd None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:30.560821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:30.562439 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:30.562898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:30.563285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] PATH_INFO: `/v3/users/1ac2e3720a324751bacef35327cc089a` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:30.575828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac2e3720a324751bacef35327cc089a)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:30.576882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:30.916000 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac2e3720a324751bacef35327cc089a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:30.925024 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac2e3720a324751bacef35327cc089a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:30.928995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac2e3720a324751bacef35327cc089a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.006100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac2e3720a324751bacef35327cc089a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.022619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-7ce4ccff-7966-4d70-a49a-19604b688ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac2e3720a324751bacef35327cc089a'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.030088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1055/2134] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:46:30 2022] DELETE /identity/v3/users/1ac2e3720a324751bacef35327cc089a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:31.320808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:31.333968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92da60c-f4d0-450d-8966-b59662bbb007 service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:31.426013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:31.427067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:31.427560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:31.428175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] PATH_INFO: `/v3/projects/b48b7431153449c2bce1a7491b573e80` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:31.438041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48b7431153449c2bce1a7491b573e80)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:31.440145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:31.570175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48b7431153449c2bce1a7491b573e80', 'request_id': 'req-c6d30a29-4015-4d5d-a309-cdc7aa41061c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.579982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48b7431153449c2bce1a7491b573e80', 'request_id': 'req-c6d30a29-4015-4d5d-a309-cdc7aa41061c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.663752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48b7431153449c2bce1a7491b573e80', 'request_id': 'req-c6d30a29-4015-4d5d-a309-cdc7aa41061c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.680716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] The token cache is being invalidate because project b48b7431153449c2bce1a7491b573e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:46:31.681190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.681944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c6d30a29-4015-4d5d-a309-cdc7aa41061c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:31.684015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1080/2135] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:46:31 2022] DELETE /identity/v3/projects/b48b7431153449c2bce1a7491b573e80 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:31.689654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:31.690148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:31.690400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:31.721319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:31.726046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:31.821431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1056/2136] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:31.831728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:31.832021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:31.832300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:31.855577 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:31.862555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:31.864067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:31.877161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1081/2137] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:31.879864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:31.887497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:31.891497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76278304-3b85-4cf5-bc3d-f05dedfd3926 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:31.898552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:31.899310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:31.899695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:31.900093 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:31.900870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:46:31.901362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:31.903077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:31.922861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1057/2138] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:46:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:46:31.929384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:31.940973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a932f-7411-4e42-905d-467c65ba053e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:31.946825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:31.947563 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:31.947951 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:31.948294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:31.949004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:31.951132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.068756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1082/2139] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:46:31 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:46:32.070830 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:32.082760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186e91d-f0b6-47c2-a56a-4014a6ea7cf1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:32.244442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:32.245195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.245484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.245764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.246430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:32.250563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.503368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1058/2140] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:46:32 2022] POST /identity/v3/users => generated 284 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:46:32.503567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:32.521464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c669ae92-6735-4e5b-8d75-f3d9d1241691 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:32.533862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:32.534721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.535896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.536251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.537086 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:32.539228 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.559420 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1083/2141] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:46:32.561272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:32.573742 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74c415-6ef8-4941-9d83-6383a2777dfb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:32.580476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:32.581282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.581780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.582062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.582728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:32.584333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5127ec-27ee-4f0f-aa98-ff2a8e61383d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.598268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1059/2142] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:46:32.599607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:32.612778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d500c4-84e9-43a5-8521-a33bec4058a2 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:32.617635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:32.621467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.621467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.621467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] PATH_INFO: `/v3/projects/d9903f78800945f88f2b2083e2a948f6/users/d6c3eefc35eb49a892ccdb8d369058f0/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.634721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9903f78800945f88f2b2083e2a948f6, user_id=d6c3eefc35eb49a892ccdb8d369058f0, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:32.637678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.757214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1084/2143] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:46:32 2022] PUT /identity/v3/projects/d9903f78800945f88f2b2083e2a948f6/users/d6c3eefc35eb49a892ccdb8d369058f0/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:32.767345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.767866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.767952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.805668 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] MFA Rules not processed for user `d6c3eefc35eb49a892ccdb8d369058f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:32.808420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:32.880081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1060/2144] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:32.892463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:32.894167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:32.961533 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3cf611-4a85-4f12-8284-2ef951bc5816 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:32.966699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:32.967550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:32.967943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:32.968218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:32.980084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:32.982112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:32.994039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1085/2145] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:40.633146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:40.635765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:40.692901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee36ac-185b-4a69-9107-251e4427c706 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:40.696485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:40.697646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:40.697921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:40.698190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:40.699973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:40.709461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:40.710889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:40.719619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1061/2146] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:41.713295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:41.714760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:41.784501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb024e09-c203-44b1-8188-89abb3be893b service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:41.789494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:41.790095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:41.790397 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:41.790670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:41.792408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:41.803544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:41.805110 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:41.815390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1086/2147] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:41.850513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:41.850513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:41.852740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:41.917382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fc01a-8994-4726-8339-389d20c53014 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:41.921918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:41.922546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:41.922828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:41.923103 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] PATH_INFO: `/v3/users/3c319d0e300b435cbe3177611e414770` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:41.924278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c319d0e300b435cbe3177611e414770)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:41.926570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:42.106715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c319d0e300b435cbe3177611e414770'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.114442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c319d0e300b435cbe3177611e414770'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.115138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c319d0e300b435cbe3177611e414770'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.232503 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c319d0e300b435cbe3177611e414770'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.246203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c319d0e300b435cbe3177611e414770'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.252321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1062/2148] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:46:41 2022] DELETE /identity/v3/users/3c319d0e300b435cbe3177611e414770 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:42.508418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:42.519949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd20f9-20a4-45b6-90da-a4bedf866590 service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:42.557703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:42.583826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:42.584384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:42.584797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:42.585077 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] PATH_INFO: `/v3/projects/2001592e21734d6db2386e7dcc97ebe3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:42.586319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2001592e21734d6db2386e7dcc97ebe3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:42.588193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:42.726134 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2001592e21734d6db2386e7dcc97ebe3', 'request_id': 'req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.733710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2001592e21734d6db2386e7dcc97ebe3', 'request_id': 'req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.805225 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2001592e21734d6db2386e7dcc97ebe3', 'request_id': 'req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.816229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] The token cache is being invalidate because project 2001592e21734d6db2386e7dcc97ebe3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:46:42.816786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.817436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-7815b1d0-6f9e-428a-9f2f-3353e1ab8553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:42.818948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1087/2149] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:46:42 2022] DELETE /identity/v3/projects/2001592e21734d6db2386e7dcc97ebe3 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:43.147244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:43.148709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:43.162294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900aedc-f352-4e87-a1ad-583b541acecb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:43.219580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:43.220133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:43.220416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:43.220697 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] PATH_INFO: `/v3/users/d6c3eefc35eb49a892ccdb8d369058f0` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:43.221863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c3eefc35eb49a892ccdb8d369058f0)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:43.223809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:43.248438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:43.459699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c3eefc35eb49a892ccdb8d369058f0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:43.466773 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c3eefc35eb49a892ccdb8d369058f0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:43.467528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c3eefc35eb49a892ccdb8d369058f0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:43.536516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c3eefc35eb49a892ccdb8d369058f0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:43.552258 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c3eefc35eb49a892ccdb8d369058f0'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:43.559181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1063/2150] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:46:43 2022] DELETE /identity/v3/users/d6c3eefc35eb49a892ccdb8d369058f0 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:43.563720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:43.563961 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:43.564242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:43.584364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:43.585704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:43.655346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1088/2151] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:46:43.665013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:43.667097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:43.729945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5170c6-ebc0-469d-8e3e-e2be5bef42d1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:43.733869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:43.734480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:43.734782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:43.735048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:43.747129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:43.748620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf64db-ff68-4d45-9326-be7f108ab031 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:43.759360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1064/2152] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:44.139561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.141155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:44.153682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d987f1-3362-49df-9bf0-06ad2326a458 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.158253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.159084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.159359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.159627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] PATH_INFO: `/v3/projects/d9903f78800945f88f2b2083e2a948f6` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.160919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9903f78800945f88f2b2083e2a948f6)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.163218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.280309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9903f78800945f88f2b2083e2a948f6', 'request_id': 'req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:44.286607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9903f78800945f88f2b2083e2a948f6', 'request_id': 'req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:44.364860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9903f78800945f88f2b2083e2a948f6', 'request_id': 'req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:44.366387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:44.376185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] The token cache is being invalidate because project d9903f78800945f88f2b2083e2a948f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:46:44.376474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:44.377099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-39836ce4-0aac-4f88-a2c4-6a9b5fa10e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:44.378700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1089/2153] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:46:44 2022] DELETE /identity/v3/projects/d9903f78800945f88f2b2083e2a948f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:44.383498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.383973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.384123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.406792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:44.408003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:44.468741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1065/2154] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:44.476329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.476621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.476900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.496726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:44.497960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:44.505812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1090/2155] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:44.510813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.521046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5c9cfc-da08-4325-a6f1-8c0201d9d20c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.526302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.526892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.527167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.527950 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.528045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:46:44.528347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.529961 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.541471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1066/2156] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:46:44.545549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.554470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbc917-3ac1-402e-be9f-6fb18c191e70 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.559575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.561654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.561654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.561654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.561654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.563215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.668821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1091/2157] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:46:44 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:46:44.673071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.683921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862408c-463b-4811-beaa-cdda1df03bd0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.717966 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:44.742396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.743005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.743284 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.743555 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.744708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.746644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.848210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1067/2158] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:46:44 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:46:44.849861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.860184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4f6af-edd8-4c41-adb0-e2795afae76d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.864806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.865461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.865743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.866019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.866666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.868285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.882367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1092/2159] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:46:44.883804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.896528 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f616c23-fcc1-4fb3-b6d7-95af57ec49fd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.901931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.902533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.902953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.903060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.903824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.905529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502bd625-33ee-4151-a9a0-1bb1099d4979 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:44.915605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1068/2160] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:46:44.920039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:44.930686 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1229fc85-21b1-43c4-b4bc-e7a66bbc4fdc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:44.936022 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:44.936677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:44.936956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:44.937265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] PATH_INFO: `/v3/projects/dbe5e6ce211240f6b4fa0cb31607727d/users/1e3376a1b3ce4d6eb4366a833269760c/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:44.952757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe5e6ce211240f6b4fa0cb31607727d, user_id=1e3376a1b3ce4d6eb4366a833269760c, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:44.955472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.033544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1093/2161] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:46:44 2022] PUT /identity/v3/projects/dbe5e6ce211240f6b4fa0cb31607727d/users/1e3376a1b3ce4d6eb4366a833269760c/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:45.046108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.046401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.046680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.076393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] MFA Rules not processed for user `1e3376a1b3ce4d6eb4366a833269760c`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:45.077595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:45.144213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1069/2162] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:45.148835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.211941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3d620-8e1d-4352-9a6b-70d1b86c2066 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.216720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.217368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.217651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.217925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.218568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.220469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.332196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1094/2163] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:46:45 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:46:45.336223 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.346802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490bd9-f2e3-4e54-9557-c6f53e6198bc None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.403617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.404245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.404492 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.404882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.405572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.407477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.508414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1070/2164] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:46:45 2022] POST /identity/v3/users => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:46:45.512277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.522694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248c073-eb5c-4157-8b6b-a66c01ef2a3d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.527941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.528611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.528899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.529198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.529841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.531424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.543241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1095/2165] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:46:45.546356 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.547250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.548272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:45.557730 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6c6a7-2431-4e38-82b3-fb8dc846791d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.562448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.563095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.563472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.563699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] PATH_INFO: `/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f/users/bea2b5ca10c44d96b662fcd7e6efbc45/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.579210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72a52b75cb44c5d8c39a2083b3b793f, user_id=bea2b5ca10c44d96b662fcd7e6efbc45, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.581994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.582418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:45.608956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb65398d-15c9-4f92-9b39-5229e4d82fee admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.612755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.613435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.613710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.614008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.615809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:45.625254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.626688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.635456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1071/2166] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:45.662217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1096/2167] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:46:45 2022] PUT /identity/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f/users/bea2b5ca10c44d96b662fcd7e6efbc45/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:46:45.666922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.678728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb11f22d-4c36-4d74-99ba-eac08106c227 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.735601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.736205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.736494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.736767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.737438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.739041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce0403-1fae-4758-9f58-1232bc41e668 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.748900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1072/2168] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:46:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:46:45.753267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.763594 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51e646-d479-4154-ab1c-007c18977031 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.768223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.768900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.769216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.769493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] PATH_INFO: `/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f/users/bea2b5ca10c44d96b662fcd7e6efbc45/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.771407 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72a52b75cb44c5d8c39a2083b3b793f, user_id=bea2b5ca10c44d96b662fcd7e6efbc45, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:45.774105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:45.784966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1097/2169] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:46:45 2022] PUT /identity/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f/users/bea2b5ca10c44d96b662fcd7e6efbc45/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:46:45.795812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.796145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.796427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:45.824608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] MFA Rules not processed for user `bea2b5ca10c44d96b662fcd7e6efbc45`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:45.825860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:45.893731 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1073/2170] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:45.905319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:45.907122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:45.933755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:45.963902 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c67d855-cb4e-4f59-99eb-841ad02e8cdf admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:45.967630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:45.968303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:45.968586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:45.968856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:46.027777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:46.029274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae9007-c11c-4e79-85f2-4817270160bb service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:46.038329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1098/2171] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:46.353933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:46.360088 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:46.410209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:46.427662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49ef1-ae4c-43b4-a5e4-d352dc9efe2d None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:46.432753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:46.440120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:46.440120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:46.440120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:46.440120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:46.447123 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:46.448714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:46.458331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1074/2172] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:48.649045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:48.649554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:48.649554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:48.670027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:48.671218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:48.726515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1099/2173] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:46:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:46:48.739497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:48.741002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:48.808796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee06747-4d07-4584-9031-213e2a7f38da service placement] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:48.813769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:48.814386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:48.814647 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:48.814922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:48.823761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:48.825416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:48.833600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1075/2174] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:46:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:46:51.251870 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:51.253430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:51.265213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a2af-824b-4db9-9e1c-ffbbb3e2ce32 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:51.269083 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:51.269709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:51.269988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:51.270260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:51.285779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:51.287427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:51.298914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1100/2175] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:57.448156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:57.449704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:57.521813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafe9c-0d40-4790-9444-918077137df8 service swift] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:57.527871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:57.530552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:57.530552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:57.530552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:57.530875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:57.591406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:57.593020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ef63-e4d7-4216-a861-e84c5568a1a0 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:57.602086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1076/2176] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:57.880607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:57.943782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070ced2-53ef-4f74-a49e-7893a64605bb service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:57.948831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:57.949488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:57.949768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:57.950071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] PATH_INFO: `/v3/users/1e3376a1b3ce4d6eb4366a833269760c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:57.951181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3376a1b3ce4d6eb4366a833269760c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:57.953102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:57.964353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:58.279459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3376a1b3ce4d6eb4366a833269760c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:58.370294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3376a1b3ce4d6eb4366a833269760c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:58.370294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3376a1b3ce4d6eb4366a833269760c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:58.370294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3376a1b3ce4d6eb4366a833269760c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:58.482896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3376a1b3ce4d6eb4366a833269760c'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:58.489319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1101/2177] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:46:57 2022] DELETE /identity/v3/users/1e3376a1b3ce4d6eb4366a833269760c => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:46:58.493816 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:58.494341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:58.494465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:58.513259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:46:58.519324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:58.519324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:58.635650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1077/2178] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:46:58.646321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:58.647913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:58.740868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3205f3-c5e8-4bc2-b508-7196884aa37d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:58.740868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:58.740868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:58.740868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:58.741366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:58.750300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:58.751765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:58.762020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1102/2179] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:46:59.320295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:59.322462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:46:59.336373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad1834-ae97-4b70-8f7f-89f9acb53ef2 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:59.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:59.346792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:59.346792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:59.346792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] PATH_INFO: `/v3/projects/dbe5e6ce211240f6b4fa0cb31607727d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:59.346792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe5e6ce211240f6b4fa0cb31607727d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:59.347336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:59.463138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe5e6ce211240f6b4fa0cb31607727d', 'request_id': 'req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:59.470190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe5e6ce211240f6b4fa0cb31607727d', 'request_id': 'req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:59.477218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe5e6ce211240f6b4fa0cb31607727d', 'request_id': 'req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:59.689985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] The token cache is being invalidate because project dbe5e6ce211240f6b4fa0cb31607727d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:46:59.690661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:59.691098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:46:59.692912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1078/2180] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:46:59 2022] DELETE /identity/v3/projects/dbe5e6ce211240f6b4fa0cb31607727d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:46:59.696802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:46:59.707447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5de0b-44d2-417b-8909-8f5b2c5d42d6 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:46:59.779486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:46:59.780121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:46:59.780401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:46:59.780675 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] PATH_INFO: `/v3/users/bea2b5ca10c44d96b662fcd7e6efbc45` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:46:59.781938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea2b5ca10c44d96b662fcd7e6efbc45)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:46:59.783855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:46:59.993316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:00.006316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea2b5ca10c44d96b662fcd7e6efbc45'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:00.014876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea2b5ca10c44d96b662fcd7e6efbc45'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:00.031049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea2b5ca10c44d96b662fcd7e6efbc45'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:00.034654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea2b5ca10c44d96b662fcd7e6efbc45'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:00.170495 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0f93ab81-d1e6-4e17-9615-f1d3793c4aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea2b5ca10c44d96b662fcd7e6efbc45'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:00.177911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1103/2181] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:46:59 2022] DELETE /identity/v3/users/bea2b5ca10c44d96b662fcd7e6efbc45 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:00.816462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:00.818762 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:00.833110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50663a-9ff9-43ad-9c4d-e6b01e96a1a6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:00.914050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:00.914919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:00.915268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:00.915687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] PATH_INFO: `/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:00.917014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72a52b75cb44c5d8c39a2083b3b793f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:00.919237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.035159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:01.044567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72a52b75cb44c5d8c39a2083b3b793f', 'request_id': 'req-52ce201f-4b68-4acd-bdd1-e5c094f69d52'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:01.050147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72a52b75cb44c5d8c39a2083b3b793f', 'request_id': 'req-52ce201f-4b68-4acd-bdd1-e5c094f69d52'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:01.056417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72a52b75cb44c5d8c39a2083b3b793f', 'request_id': 'req-52ce201f-4b68-4acd-bdd1-e5c094f69d52'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:01.144934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] The token cache is being invalidate because project f72a52b75cb44c5d8c39a2083b3b793f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:01.145212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:01.145837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-52ce201f-4b68-4acd-bdd1-e5c094f69d52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:01.147357 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1079/2182] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:00 2022] DELETE /identity/v3/projects/f72a52b75cb44c5d8c39a2083b3b793f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:01.153427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.153967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.154070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.173413 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:01.179293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:01.238721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1104/2183] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:01.247601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.247905 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.248166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.269262 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:01.270517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:01.278483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1080/2184] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:01.284480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.294697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183e1f4-09cf-441b-83e3-bf3ec8c05930 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.299527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.300207 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.300560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.300933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.301701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:01.302109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.303800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.317027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1105/2185] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:47:01.321673 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.332336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa80b-76f8-4884-bcae-5d235289ce7c None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.337194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.342199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.437420 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1081/2186] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:01 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:01.441829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.452548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee8575-39c2-4c23-bb67-f8d3cfe1e490 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.508096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.508697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.508981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.509299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.509974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.511916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.621096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1106/2187] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:01 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:01.625075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.635626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f2775-ccc5-4bf3-80db-350db8a88ded admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.640595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.644043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.644325 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.644620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.645299 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.647643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.657207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1082/2188] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:01.661246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.672608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd330bae-c81e-4a76-a8a9-21caafae8e0d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.677323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.677930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.678213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.678489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.679138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.680732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954915a8-a255-4603-bfea-3a2374115746 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.695508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1107/2189] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:01.696514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.706671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f43997-91c7-4fee-bf08-57c3a295d6d2 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:01.711453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:01.712121 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.712405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.712718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] PATH_INFO: `/v3/projects/c8575232709d45dcb7eb4742acd5fb13/users/a2bea10610144c5596ba872ea1f76a2d/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.729339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8575232709d45dcb7eb4742acd5fb13, user_id=a2bea10610144c5596ba872ea1f76a2d, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:01.731994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:01.819684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1083/2190] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:01 2022] PUT /identity/v3/projects/c8575232709d45dcb7eb4742acd5fb13/users/a2bea10610144c5596ba872ea1f76a2d/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:01.832102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:01.832386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:01.832660 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:01.860296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] MFA Rules not processed for user `a2bea10610144c5596ba872ea1f76a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:01.861593 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:01.865530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:01.926544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1108/2191] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:01.937763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:01.939737 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:01.997109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c54d0-691b-4676-a64d-b260f19a4dce admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:02.000812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:02.001449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:02.001735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:02.002011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:02.010278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:02.011706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:02.020473 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1084/2192] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:06.853737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:06.855200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:06.932211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3dafa-55b7-4751-a31f-cb4860638e4b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:06.937682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:06.938288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:06.938836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:06.939105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:06.940843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:06.953942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:06.955524 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07793b1f-d275-4618-8254-d2e61a2685d7 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:06.966741 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1109/2193] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:08.928442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:08.991604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31cb809-1dd5-495f-b7eb-f1ac7fbd8e25 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:08.996823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:08.997554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:08.997845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:08.998125 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] PATH_INFO: `/v3/users/a2bea10610144c5596ba872ea1f76a2d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:08.999295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2bea10610144c5596ba872ea1f76a2d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:09.001339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:09.003763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:09.137926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2bea10610144c5596ba872ea1f76a2d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:09.145759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2bea10610144c5596ba872ea1f76a2d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:09.146609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2bea10610144c5596ba872ea1f76a2d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:09.240612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2bea10610144c5596ba872ea1f76a2d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:09.253679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7bf32ce-7c92-42f6-82fa-68a43f8df46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2bea10610144c5596ba872ea1f76a2d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:09.259616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1085/2194] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:08 2022] DELETE /identity/v3/users/a2bea10610144c5596ba872ea1f76a2d => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:09.264274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:09.264776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:09.264883 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:09.283663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:09.284880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:09.332429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:09.332429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:09.332429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:09.355072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1110/2195] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:09.364768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:09.365001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:09.366155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:09.366293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:09.400481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:09.423066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1086/2196] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:09.424391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04315cc-c9a0-464a-959f-5245884158ae None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:09.428058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:09.428937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:09.429474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:09.430078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:09.436259 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:09.437600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:09.440012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:09.441667 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:09.451562 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1111/2197] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:09.512529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc954ba4-7940-46e5-88ed-afb785a02b6a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:09.515081 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:09.515694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:09.515976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:09.516251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:09.524570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:09.526879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704c89b-414c-4f35-984d-349349a97315 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:09.535156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1087/2198] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 12 12:47:09.883973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:09.886005 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:09.899310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f5505-2547-438c-a661-c49b58094ccc service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:09.911502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:09.912677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:09.913023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:09.913294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] PATH_INFO: `/v3/projects/c8575232709d45dcb7eb4742acd5fb13` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:09.925717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8575232709d45dcb7eb4742acd5fb13)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:09.925717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.072198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8575232709d45dcb7eb4742acd5fb13', 'request_id': 'req-c887f732-d2b6-4e8a-84ca-24a1c6886e16'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:10.079227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8575232709d45dcb7eb4742acd5fb13', 'request_id': 'req-c887f732-d2b6-4e8a-84ca-24a1c6886e16'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:10.133974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8575232709d45dcb7eb4742acd5fb13', 'request_id': 'req-c887f732-d2b6-4e8a-84ca-24a1c6886e16'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:10.148825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] The token cache is being invalidate because project c8575232709d45dcb7eb4742acd5fb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:10.149138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:10.150312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c887f732-d2b6-4e8a-84ca-24a1c6886e16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:10.151872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1112/2199] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:09 2022] DELETE /identity/v3/projects/c8575232709d45dcb7eb4742acd5fb13 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:10.156826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.157323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.157440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.180245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:10.185012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:10.199226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:10.272374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1088/2200] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:10.274709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.275309 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.275584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.297996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:10.299617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:10.316068 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1113/2201] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:10.317527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.329365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e17d5-4901-4581-b9ec-23056e9b7d96 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.336997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.337664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.338014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.339018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.341841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:10.341841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.342143 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.356598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1089/2202] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:10.361099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.370616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027f0b0a-3c12-4c21-89aa-3da443fc88de None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.375627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.376244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.376522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.376795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.377518 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.379424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.467546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1114/2203] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:10 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:10.472009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.483091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76122474-ebf4-42ef-b80d-8ba1210e8b5b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.540065 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.540765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.541048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.542011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.542680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.544919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.725650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1090/2204] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:10 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:10.727027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.738566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d668ea8-bebb-4bb3-ba79-7e31a02f4508 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.743259 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.744006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.744291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.745150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.745802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.748355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.761725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1115/2205] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:10.765982 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.778368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb69f0-cb2c-4bb3-9998-1e0b1d7f849e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.783867 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.784487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.784771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.785048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.785757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.787387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65905a9-bf39-4496-ae39-6958fa0a7884 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.799620 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1091/2206] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:10.803681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:10.815484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588e2f4-033f-4eec-a3db-438547b434d8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:10.820127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:10.820786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.821258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.821394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] PATH_INFO: `/v3/projects/4a4f0ed8a00b4ffda73d8ddbc871062f/users/a1e9ba12faa04eaab2dccad8651fdcb4/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.836891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4f0ed8a00b4ffda73d8ddbc871062f, user_id=a1e9ba12faa04eaab2dccad8651fdcb4, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:10.840188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:10.911465 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1116/2207] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:10 2022] PUT /identity/v3/projects/4a4f0ed8a00b4ffda73d8ddbc871062f/users/a1e9ba12faa04eaab2dccad8651fdcb4/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:10.921895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:10.922188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:10.922468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:10.952881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] MFA Rules not processed for user `a1e9ba12faa04eaab2dccad8651fdcb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:10.954191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:11.035240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1092/2208] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:11.036435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.055151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.056806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:11.081702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:11.137700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:11.159626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e1516-69b3-4a8b-b2e2-bd4aad6c003c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.170944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.172707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.174360 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.174813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.175672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.177966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.194041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa52b9b-61d5-459d-b6ff-4134d33d3714 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.208296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.212170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.212170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.212170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.212170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:11.229296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.229296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.246006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1093/2209] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:11.295659 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1117/2210] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:11 2022] POST /identity/v3/projects => generated 385 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:11.296827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.308485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8878a089-d6a8-45b5-a492-7ad80e798556 service nova] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.378371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.379183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.379320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.379508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.380869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.382650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.468527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1094/2211] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:11 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:11.469884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.480670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ab128-39c7-436d-ab76-a43a9bd871f9 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.485257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.485854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.486133 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.486406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.487044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.488634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.500436 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1118/2212] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:11.504909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.516018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1d946-3c62-41db-aa31-6c24539e3422 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.521431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.522137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.522510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.522910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.523570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.525324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6f72a-1d96-4f43-ac2f-fa68a3532246 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.539923 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1095/2213] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:11.541272 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.553486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636d7d-edec-4d9b-8402-b1b026863945 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.558875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.559632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.559990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.560338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] PATH_INFO: `/v3/projects/d4aeb97371d34bc1a6011d4c178b283b/users/69a921196b6b433397cd97fe771b5014/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.580450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4aeb97371d34bc1a6011d4c178b283b, user_id=69a921196b6b433397cd97fe771b5014, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.583663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:11.716613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1119/2214] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:11 2022] PUT /identity/v3/projects/d4aeb97371d34bc1a6011d4c178b283b/users/69a921196b6b433397cd97fe771b5014/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:11.731818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.732016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.732285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.762323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] MFA Rules not processed for user `69a921196b6b433397cd97fe771b5014`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:11.763580 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:11.832696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1096/2215] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:11.837450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:11.910059 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec281cb8-d9f2-49aa-9675-da79d5bdcb68 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:11.915016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:11.915631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:11.916338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:11.916338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:11.916886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:11.918829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.009612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1120/2216] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:11 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:12.012939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.022765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:12.027956 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c144bb6-aaef-48a7-a5d2-7f665a1bab5a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.100992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.101635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.101913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.102179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.102809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.105371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.237322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1097/2217] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:12 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:12.242226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.253907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3893f263-8044-459a-a654-fface3e47681 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.258595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.259282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.259586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.259909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.260555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.262408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.274485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1121/2218] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:12.278556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.289384 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a172e-0a7a-42d6-b130-a92856810400 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.295008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.295657 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.295935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.296204 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] PATH_INFO: `/v3/projects/8a45c10390c54625a69240c0fb8554b6/users/9da6f7f841dc467cb812855c05de2a76/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.311639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a45c10390c54625a69240c0fb8554b6, user_id=9da6f7f841dc467cb812855c05de2a76, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.314802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.395903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1098/2219] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:12 2022] PUT /identity/v3/projects/8a45c10390c54625a69240c0fb8554b6/users/9da6f7f841dc467cb812855c05de2a76/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:12.399887 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.410398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3239d15-4645-4493-bdeb-20caf684c032 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.468534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.469152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.469447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.469719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.470370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.471981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182766c8-02f4-45c8-b1c9-51fb97b32481 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.485825 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1122/2220] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:12.486709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.497442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a71034e-94fd-4dcd-8065-ad89da8e6241 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.501940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.502583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.503019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.503310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] PATH_INFO: `/v3/projects/8a45c10390c54625a69240c0fb8554b6/users/9da6f7f841dc467cb812855c05de2a76/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.505219 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a45c10390c54625a69240c0fb8554b6, user_id=9da6f7f841dc467cb812855c05de2a76, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.507853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.518082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1099/2221] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:12 2022] PUT /identity/v3/projects/8a45c10390c54625a69240c0fb8554b6/users/9da6f7f841dc467cb812855c05de2a76/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:12.528829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.529119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.529424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.556054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:12.559095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] MFA Rules not processed for user `9da6f7f841dc467cb812855c05de2a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:12.560361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:12.631154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1123/2222] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:12.644097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:12.645797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:12.703547 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243ee3d-c01e-4b96-a6f4-92637141f3ea admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:12.707199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:12.707863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:12.708155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:12.708410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:12.775315 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:12.777338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:12.786515 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1100/2223] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:14.737447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:14.738930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:14.750807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773657-6ddd-49ec-94c2-67490e03ecce None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:14.754387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:14.754982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:14.755265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:14.755539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:14.814978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:14.816416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:14.825544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1124/2224] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:16.366248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:16.374903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da56ea-993e-43d8-bff4-569d997a13b8 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:16.378567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:16.379165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:16.381238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:16.381238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:16.389347 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:16.390770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:16.394784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:16.401151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1101/2225] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:17.624986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:17.626414 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:17.682652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597e8d-2861-4d08-9d09-d1d7d809390d service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:17.686565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:17.687175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:17.687711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:17.687969 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:17.689711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:17.742661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:17.757071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:17.758677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac3ade5-0cf2-4595-be19-285519b43802 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:17.768852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1125/2226] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:21.306670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:21.331320 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb947-a80c-44cf-83d3-ab45aa62e014 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:21.340266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:21.340921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:21.342559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:21.342559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] PATH_INFO: `/v3/users/a1e9ba12faa04eaab2dccad8651fdcb4` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:21.342869 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e9ba12faa04eaab2dccad8651fdcb4)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:21.345004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:21.552556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e9ba12faa04eaab2dccad8651fdcb4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:21.560188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e9ba12faa04eaab2dccad8651fdcb4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:21.560865 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e9ba12faa04eaab2dccad8651fdcb4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:21.646548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e9ba12faa04eaab2dccad8651fdcb4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:21.669310 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e9ba12faa04eaab2dccad8651fdcb4'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:21.704716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1102/2227] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:21 2022] DELETE /identity/v3/users/a1e9ba12faa04eaab2dccad8651fdcb4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:21.704839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:21.704839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:21.704839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:21.716576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:21.717988 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:21.780862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1126/2228] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:21.790274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:21.791771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:21.853538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60302-3cf6-48f8-a15b-45a8c63dca58 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:21.857740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:21.858414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:21.858756 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:21.859092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:21.868279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:21.869761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:21.879694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1103/2229] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:21.933758 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:21.935329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:21.954060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daf4b0-1aeb-4a7c-b029-e2c036c2c342 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:21.958652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:21.959536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:21.959648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:21.959859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] PATH_INFO: `/v3/users/56392b5a93bb44c2a859f3751902772e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:21.961018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=56392b5a93bb44c2a859f3751902772e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:21.962967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:22.191777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56392b5a93bb44c2a859f3751902772e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.199927 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56392b5a93bb44c2a859f3751902772e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.212821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56392b5a93bb44c2a859f3751902772e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.213603 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56392b5a93bb44c2a859f3751902772e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.308821 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56392b5a93bb44c2a859f3751902772e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.315732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1127/2230] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:21 2022] DELETE /identity/v3/users/56392b5a93bb44c2a859f3751902772e => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:22.367761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:22.372380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:22.384987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13f009-d398-42c3-94df-45dd184073d5 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:22.447588 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:22.448237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:22.449064 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:22.449410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] PATH_INFO: `/v3/projects/4a4f0ed8a00b4ffda73d8ddbc871062f` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:22.450741 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4f0ed8a00b4ffda73d8ddbc871062f)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:22.452706 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:22.470921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:22.600418 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4f0ed8a00b4ffda73d8ddbc871062f', 'request_id': 'req-dfc241b3-4f03-4b95-87f4-fca7ea167024'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.605842 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4f0ed8a00b4ffda73d8ddbc871062f', 'request_id': 'req-dfc241b3-4f03-4b95-87f4-fca7ea167024'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.611992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4f0ed8a00b4ffda73d8ddbc871062f', 'request_id': 'req-dfc241b3-4f03-4b95-87f4-fca7ea167024'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.625175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:22.626605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:22.640450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a688359e-e77c-4bde-a281-0ee39f6f52ec admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:22.699622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:22.700251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:22.700531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:22.700803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] PATH_INFO: `/v3/projects/61e5cce6874049ffbc45488597c6be30` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:22.702076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e5cce6874049ffbc45488597c6be30)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:22.704062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:22.705539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:22.736462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] The token cache is being invalidate because project 4a4f0ed8a00b4ffda73d8ddbc871062f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:22.736794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.737499 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.739257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1104/2231] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:22 2022] DELETE /identity/v3/projects/4a4f0ed8a00b4ffda73d8ddbc871062f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:22.743170 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:22.744529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:22.757010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc241b3-4f03-4b95-87f4-fca7ea167024 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:22.762440 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:22.763101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:22.763378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:22.763676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] PATH_INFO: `/v3/users/69a921196b6b433397cd97fe771b5014` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:22.764846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a921196b6b433397cd97fe771b5014)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:22.766903 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:22.809472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e5cce6874049ffbc45488597c6be30', 'request_id': 'req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.817894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e5cce6874049ffbc45488597c6be30', 'request_id': 'req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.887152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e5cce6874049ffbc45488597c6be30', 'request_id': 'req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.897680 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] The token cache is being invalidate because project 61e5cce6874049ffbc45488597c6be30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:22.897965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.898576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-51ff1c6e-fdb1-47a7-9546-e22452a5ee2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.900049 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1128/2232] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:22 2022] DELETE /identity/v3/projects/61e5cce6874049ffbc45488597c6be30 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:22.906218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085bd-26d7-4db3-9144-e233b401e097 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:22.906499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085bd-26d7-4db3-9144-e233b401e097 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:22.906803 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa085bd-26d7-4db3-9144-e233b401e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:22.926792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8aa085bd-26d7-4db3-9144-e233b401e097 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:22.927998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8aa085bd-26d7-4db3-9144-e233b401e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:22.929631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a921196b6b433397cd97fe771b5014'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.937700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a921196b6b433397cd97fe771b5014'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.938419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a921196b6b433397cd97fe771b5014'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:22.988171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1129/2233] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:22.996615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:22.996899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:22.997206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.004703 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a921196b6b433397cd97fe771b5014'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.017298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:23.018503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:23.018749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a921196b6b433397cd97fe771b5014'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.026004 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1105/2234] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:22 2022] DELETE /identity/v3/users/69a921196b6b433397cd97fe771b5014 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:23.033195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1130/2235] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:23.035012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.100038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cd10e-3f2d-4beb-93c5-3ac4404f450f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.105247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.105952 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.106441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.106845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.107573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:23.107951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.109834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.123275 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1106/2236] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:23.127187 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.136867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef24a95-b9b0-4f9c-9ec2-4fd9e7fc5977 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.146185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.146185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.146185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.146185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.146582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.146582 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.233602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1131/2237] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:23 2022] POST /identity/v3/projects => generated 367 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:23.234759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.245947 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc2a13-dcaa-4714-9d20-231a5cb16c8a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.250877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:23.309514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.310277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.310563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.311246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.311468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.314216 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.418416 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1107/2238] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:23 2022] POST /identity/v3/users => generated 284 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:23.422489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.433486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c954f5-eadb-4f76-9dee-9c9552262297 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.438532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.439192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.439473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.439772 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.440478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.442189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.452042 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1132/2239] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:23.458477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.468806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77d49c-892b-4e2d-95d3-d386052c90de admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.473753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.474656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.475381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.475662 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.476317 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.478029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.488676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1108/2240] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:23.498672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.508986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9039-349f-4a7b-ad3b-d7a4d9368989 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.513769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.514444 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.514684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.518597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] PATH_INFO: `/v3/projects/9f40ea7428224fa59e55bd5aed6da473/users/ca5b174c04bc4456b24fbd70ac7fbde4/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.521655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.523425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:23.534814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f40ea7428224fa59e55bd5aed6da473, user_id=ca5b174c04bc4456b24fbd70ac7fbde4, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.537493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942354e-f02f-444b-993e-1c0ca58260e6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.538452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9eb077-9332-46e7-b2e8-8cb293915eec admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.543089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.543796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.544069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.544337 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] PATH_INFO: `/v3/projects/d4aeb97371d34bc1a6011d4c178b283b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.545494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4aeb97371d34bc1a6011d4c178b283b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.547411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.675220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1133/2241] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:23 2022] PUT /identity/v3/projects/9f40ea7428224fa59e55bd5aed6da473/users/ca5b174c04bc4456b24fbd70ac7fbde4/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:23.685069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.685401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.685674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.713654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] MFA Rules not processed for user `ca5b174c04bc4456b24fbd70ac7fbde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:23.715438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4aeb97371d34bc1a6011d4c178b283b', 'request_id': 'req-8fd10e03-cc84-4995-8a28-e7cc44cc6710'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.715607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:23.721594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4aeb97371d34bc1a6011d4c178b283b', 'request_id': 'req-8fd10e03-cc84-4995-8a28-e7cc44cc6710'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.728646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:23.728902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4aeb97371d34bc1a6011d4c178b283b', 'request_id': 'req-8fd10e03-cc84-4995-8a28-e7cc44cc6710'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.779848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1134/2242] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:23.784158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.816945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] The token cache is being invalidate because project d4aeb97371d34bc1a6011d4c178b283b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:23.817397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.818242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:23.819890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1109/2243] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:23 2022] DELETE /identity/v3/projects/d4aeb97371d34bc1a6011d4c178b283b => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:23.824048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.825403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:23.847850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca97b018-4e37-4211-a60d-3967cba880ef None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.852679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.853332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.853606 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.853873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.856053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.857999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.890564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd10e03-cc84-4995-8a28-e7cc44cc6710 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:23.895248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:23.895912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:23.896188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:23.901260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] PATH_INFO: `/v3/users/9da6f7f841dc467cb812855c05de2a76` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:23.901260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da6f7f841dc467cb812855c05de2a76)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:23.901260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:23.912474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:23.956179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1135/2244] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:23 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:23.960596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:23.962233 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.024417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce90c9-9bea-46a4-8020-c3a50a132fef admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.029774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.030371 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.030649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.030919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.031589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.033536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.082722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da6f7f841dc467cb812855c05de2a76'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.090197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da6f7f841dc467cb812855c05de2a76'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.090882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da6f7f841dc467cb812855c05de2a76'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.160327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1136/2245] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:23 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:24.164117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.165677 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.177493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28911bfc-7eba-4552-bdc7-78d6a3883db7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.182267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.182861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.189260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.189260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.189498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da6f7f841dc467cb812855c05de2a76'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.189602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.189602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.199346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1137/2246] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:24.199516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da6f7f841dc467cb812855c05de2a76'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.200280 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.205407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1110/2247] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:23 2022] DELETE /identity/v3/users/9da6f7f841dc467cb812855c05de2a76 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:24.210127 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ee76-0ab9-4e1e-a40e-6c01ca944f66 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.227702 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:24.267687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.268353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.268638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.268917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] PATH_INFO: `/v3/projects/9c666b3683da4184b142fa9d53be3b38/users/fc894b420ae4480b85a6dc8a1bfcbbb9/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.284182 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c666b3683da4184b142fa9d53be3b38, user_id=fc894b420ae4480b85a6dc8a1bfcbbb9, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.286907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.389919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1138/2248] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:24 2022] PUT /identity/v3/projects/9c666b3683da4184b142fa9d53be3b38/users/fc894b420ae4480b85a6dc8a1bfcbbb9/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:24.393914 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.404007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e3449-81fc-4169-a66c-7fe2b19abc03 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.469280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.473255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.473255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.473255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.473255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.473255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e40c8-57ff-4275-b305-15f14e065eb0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.487328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1111/2249] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:24.488729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.500167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e9e64-d1fa-4432-b86d-19372c2d385d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.504973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.505663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.505945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.506218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] PATH_INFO: `/v3/projects/9c666b3683da4184b142fa9d53be3b38/users/fc894b420ae4480b85a6dc8a1bfcbbb9/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.508255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c666b3683da4184b142fa9d53be3b38, user_id=fc894b420ae4480b85a6dc8a1bfcbbb9, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.511622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.522302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1139/2250] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:24 2022] PUT /identity/v3/projects/9c666b3683da4184b142fa9d53be3b38/users/fc894b420ae4480b85a6dc8a1bfcbbb9/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:24.533964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.534255 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.534612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.564341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] MFA Rules not processed for user `fc894b420ae4480b85a6dc8a1bfcbbb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:24.566421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.634294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1112/2251] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:24.646138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.647900 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.662527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.663985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.684650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:24.725222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bb467-f391-490a-be73-98daa945f518 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.729027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.730210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.730491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.730765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.738139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab09db-329d-45b9-9a1c-f6888e71ac02 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.739892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.741362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.743587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.744217 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.744490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.744781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] PATH_INFO: `/v3/projects/8a45c10390c54625a69240c0fb8554b6` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.746472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a45c10390c54625a69240c0fb8554b6)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:24.748375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:24.754974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1140/2252] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:24.877892 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:24.879318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.891081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4dba9d-0e78-4d65-a62e-adbf40ba5c92 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:24.905150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a45c10390c54625a69240c0fb8554b6', 'request_id': 'req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.911375 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a45c10390c54625a69240c0fb8554b6', 'request_id': 'req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.917690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a45c10390c54625a69240c0fb8554b6', 'request_id': 'req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:24.940762 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:24.941404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:24.941689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:24.941960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:24.943767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:24.990433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:25.003099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.004555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aad1bc-aa8c-4ead-ad03-3a8ffa3df33b service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.011271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] The token cache is being invalidate because project 8a45c10390c54625a69240c0fb8554b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:25.011577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:25.012237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c0d7068e-0b11-4853-9da4-7ea2b42e4e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:25.014688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1141/2253] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:25.014796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1113/2254] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:24 2022] DELETE /identity/v3/projects/8a45c10390c54625a69240c0fb8554b6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:25.018528 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.018817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.019084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.039919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:25.040809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:25.101527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1142/2255] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:25.110381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.110667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.110943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.132606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:25.134339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:25.142906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1114/2256] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:25.147449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.157189 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41f7a5-9d97-416d-abbf-e9c17ce3cc49 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.161757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.162353 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.162632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.162906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.163549 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:25.163881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.165531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.176997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1143/2257] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:25.181451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.191614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b12306-c158-4750-bf74-aaa4c50b919b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.196404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.197006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.197328 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.197606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.198917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.200719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.310069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1115/2258] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:25.314620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.325853 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e50ac-9029-4263-b961-d8920b61865b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.385008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.385714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.386506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.386801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.387433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.389368 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.462274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1144/2259] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:25.466522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.476884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ca0bee-0615-44c3-9154-0fdf89ccf11a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.482160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.482755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.483032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.483301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.483943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.485570 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.496188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1116/2260] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:25.500308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.510232 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d224686a-bc96-47a6-8dff-6008382a1729 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.514923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.515510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.515802 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.516064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.516699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.518376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8bde4-0d4d-4950-9f1e-1575ad66b1a1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.528809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1145/2261] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:25.532852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.543364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19b0e9-d166-41a9-9bf8-596a5a838c8a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.548220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.548878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.549184 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.549548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] PATH_INFO: `/v3/projects/f30d660fa19f4fa096a377ca4ded4616/users/1754427925ab41419cb341f03d26b978/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.571047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f30d660fa19f4fa096a377ca4ded4616, user_id=1754427925ab41419cb341f03d26b978, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.573804 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:25.713575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1117/2262] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:25 2022] PUT /identity/v3/projects/f30d660fa19f4fa096a377ca4ded4616/users/1754427925ab41419cb341f03d26b978/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:25.723996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.724287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.724564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.753522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] MFA Rules not processed for user `1754427925ab41419cb341f03d26b978`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:25.754757 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:25.796142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:25.818545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1146/2263] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:25.823151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:25.865213 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:25.886329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2237d-aa06-42a1-8f12-efeed24c3f40 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:25.891112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:25.891716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:25.891996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:25.892270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:25.892908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:25.894909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.024270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1118/2264] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:25 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:26.029036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.039602 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0982b64-d7cc-4b25-944b-e7368ae428cb None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.097063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.097732 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.098045 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.098323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.098979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.101071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.233770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1147/2265] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:26 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:26.237481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.247519 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab79c1-8504-4c64-a8fb-9f4c38f18170 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.252010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.252595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.256549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.256549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.256549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.256549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.265506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1119/2266] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:26.269341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.285260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dff6af2-b678-471e-9dcf-85cdc41fcd8b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.289907 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.290505 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.290787 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.291065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.291701 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.293336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d5941-0c32-4592-ad2a-e07ee1658562 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.303357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1148/2267] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:26.307551 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.317841 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb44111-c604-4acd-8a38-112703208047 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.322352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.322994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.323272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.323545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] PATH_INFO: `/v3/projects/645d255f816f4046a5222b373f7d3288/users/5ac226f017934df0bcc41b2a3eb83090/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.338960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645d255f816f4046a5222b373f7d3288, user_id=5ac226f017934df0bcc41b2a3eb83090, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.342296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.432442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1120/2268] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:26 2022] PUT /identity/v3/projects/645d255f816f4046a5222b373f7d3288/users/5ac226f017934df0bcc41b2a3eb83090/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:26.442860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.443132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.443403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.476253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] MFA Rules not processed for user `5ac226f017934df0bcc41b2a3eb83090`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:26.477638 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:26.540526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1149/2269] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:26.546180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.607579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15f99f-5424-48d0-bbc1-61b649633b70 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.612228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.612884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.613099 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.613403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.614037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.615928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.698700 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1121/2270] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:26 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:26.705934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.716923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371e58-34c7-40f7-af05-ea379daa6438 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.765653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:26.775651 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.776250 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.776525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.776796 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.777491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.779394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.858666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1150/2271] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:26 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:26.861776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.872778 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5101310a-bdda-4673-8a8a-87558107aa79 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.877457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.878058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.878336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.878718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.879298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.880892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:26.891404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1122/2272] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:26.895377 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:26.905311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605336c-7682-4c49-8c96-ac871fa3dd4e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:26.909991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:26.910630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:26.912507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:26.912507 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] PATH_INFO: `/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7/users/d1e1a22548574a98bc9ad89199f549ec/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:26.926119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd1556f26bd4634bf0973f494b1e7f7, user_id=d1e1a22548574a98bc9ad89199f549ec, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:26.928785 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:27.000595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1151/2273] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:26 2022] PUT /identity/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7/users/d1e1a22548574a98bc9ad89199f549ec/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:27.004819 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:27.015145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3416037-eaf7-44ae-b3c9-76c437112fb2 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:27.072939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:27.073643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:27.073928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:27.074202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:27.074884 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:27.076488 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5794b-81e2-4cab-af85-c66e04c38d1b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:27.078598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:27.086626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1123/2274] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:27.091015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:27.101372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc0ca4-4e3a-4c53-9db3-101e6d951b1e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:27.106367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:27.107011 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:27.107294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:27.107567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] PATH_INFO: `/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7/users/d1e1a22548574a98bc9ad89199f549ec/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:27.109529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bd1556f26bd4634bf0973f494b1e7f7, user_id=d1e1a22548574a98bc9ad89199f549ec, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:27.112181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:27.123330 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1152/2275] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:27 2022] PUT /identity/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7/users/d1e1a22548574a98bc9ad89199f549ec/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:27.188491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:27.188779 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:27.189057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:27.216502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] MFA Rules not processed for user `d1e1a22548574a98bc9ad89199f549ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:27.217763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:27.286608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1124/2276] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:27 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:27.299689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:27.301437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:27.362801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feab327-8129-4931-8d24-ec8b97332c81 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:27.366514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:27.367111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:27.367391 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:27.367663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:27.423656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:27.425098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:27.434193 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1153/2277] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:29.358437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:29.371955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d867-a9e4-4a19-a224-45a85a86be29 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:29.375704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:29.376374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:29.376716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:29.376993 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:29.433835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:29.435212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71660a07-d7a9-400a-9c9d-5dc351d1de08 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:29.444727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1125/2278] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:29.695962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:29.697498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:29.759676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:29.764448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a48dd0-8cac-47c2-8c37-77c2be372d54 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:29.769293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:29.769928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:29.770210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:29.770486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] PATH_INFO: `/v3/users/ca5b174c04bc4456b24fbd70ac7fbde4` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:29.772464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5b174c04bc4456b24fbd70ac7fbde4)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:29.773696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:29.979138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5b174c04bc4456b24fbd70ac7fbde4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:29.986823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5b174c04bc4456b24fbd70ac7fbde4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:29.999835 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5b174c04bc4456b24fbd70ac7fbde4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.000538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5b174c04bc4456b24fbd70ac7fbde4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.062392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5b174c04bc4456b24fbd70ac7fbde4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.068674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1154/2279] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:29 2022] DELETE /identity/v3/users/ca5b174c04bc4456b24fbd70ac7fbde4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:30.073311 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:30.073600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:30.073941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:30.092694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:30.093920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:30.155137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1126/2280] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:30.164890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:30.166367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:30.226297 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4164-e593-4879-b9f3-27389bf30332 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:30.230050 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:30.231082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:30.231359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:30.231627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:30.240815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:30.242460 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:30.252800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1155/2281] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:30.702866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:30.711319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:30.718610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75b669-a3a8-4215-9163-7ecc047096a3 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:30.724212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:30.724855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:30.725150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:30.725605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] PATH_INFO: `/v3/projects/9f40ea7428224fa59e55bd5aed6da473` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:30.726652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f40ea7428224fa59e55bd5aed6da473)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:30.729372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:30.747951 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:30.852078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:30.853530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:30.859288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f40ea7428224fa59e55bd5aed6da473', 'request_id': 'req-24184993-0afb-403e-9bcd-0c7a439dd09b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.865055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f40ea7428224fa59e55bd5aed6da473', 'request_id': 'req-24184993-0afb-403e-9bcd-0c7a439dd09b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.871988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f40ea7428224fa59e55bd5aed6da473', 'request_id': 'req-24184993-0afb-403e-9bcd-0c7a439dd09b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.911568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f7bc4-c93e-4717-bbe1-adbb6585f32d service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:30.942964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:30.959632 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:30.960264 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:30.960546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:30.960820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:30.962589 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:30.992840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] The token cache is being invalidate because project 9f40ea7428224fa59e55bd5aed6da473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:30.993164 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.993811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:30.995326 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1127/2282] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:30 2022] DELETE /identity/v3/projects/9f40ea7428224fa59e55bd5aed6da473 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:30.999724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:31.001181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:31.031361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:31.032790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:31.042305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1156/2283] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:31.069877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24184993-0afb-403e-9bcd-0c7a439dd09b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:31.075293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:31.075922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:31.076202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:31.076478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] PATH_INFO: `/v3/users/fc894b420ae4480b85a6dc8a1bfcbbb9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:31.077648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc894b420ae4480b85a6dc8a1bfcbbb9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:31.079576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:31.323815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc894b420ae4480b85a6dc8a1bfcbbb9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:31.332970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc894b420ae4480b85a6dc8a1bfcbbb9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:31.333736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc894b420ae4480b85a6dc8a1bfcbbb9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:31.410526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc894b420ae4480b85a6dc8a1bfcbbb9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:31.423660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-e93e93cf-df40-4737-af11-b3ce234b56d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc894b420ae4480b85a6dc8a1bfcbbb9'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:31.429635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1128/2284] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:30 2022] DELETE /identity/v3/users/fc894b420ae4480b85a6dc8a1bfcbbb9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:32.143634 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.154626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea014ca-2d8d-455c-b6ef-9a131005172d service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.214067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.215222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.215517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.215792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] PATH_INFO: `/v3/projects/9c666b3683da4184b142fa9d53be3b38` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.216906 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c666b3683da4184b142fa9d53be3b38)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.218857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:32.337318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c666b3683da4184b142fa9d53be3b38', 'request_id': 'req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:32.344806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c666b3683da4184b142fa9d53be3b38', 'request_id': 'req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:32.444576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c666b3683da4184b142fa9d53be3b38', 'request_id': 'req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:32.456488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] The token cache is being invalidate because project 9c666b3683da4184b142fa9d53be3b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:32.456776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:32.457433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a67e9d7a-e6d8-4cdd-918a-9ff163f68ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:32.459037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1157/2285] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:32 2022] DELETE /identity/v3/projects/9c666b3683da4184b142fa9d53be3b38 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:32.465265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.465767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.465767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.485559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:32.486766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:32.505710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:32.545229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1129/2286] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:32.553027 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.570500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.570500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.575065 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:32.576288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:32.584168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1158/2287] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:32.588556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.598085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ec29-c4ec-41d1-b1e1-5445abe27287 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.602794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.603393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.603670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.603943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.604590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:32.604894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.606556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:32.617806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1130/2288] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:32.622526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.631720 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062f8e6e-56ba-497b-ab35-ffddb26cb871 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.636346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.637556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.637844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.638119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.638749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.640684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:32.645995 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:32.741931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1159/2289] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:32 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:32.746664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.756549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141691e-a69d-4762-8f15-a9b8ed8498d1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.812381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.813009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.813424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.813707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.814338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.816266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:32.931788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1131/2290] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:32 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:32.938081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.948329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ed1f-db4c-477a-b036-5874ded4ce9c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.953177 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.957931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.957931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.957931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.957931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.957931 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:32.967510 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1160/2291] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:32.971511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:32.982386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e7499-5fcb-4fa3-9b18-d648f4e287dd admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:32.987235 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:32.987875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:32.988163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:32.988431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:32.989227 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:32.990931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a61dc59-cc95-4a81-be95-5b909f223067 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.002556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1132/2292] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:33.009605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.017084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a4721-8f93-4225-b8f0-9f6d00a064b3 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.022048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.022698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.022977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.023279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] PATH_INFO: `/v3/projects/a9897665eef5470c80acccf6f87b8761/users/f6e2442eb4d94927a77bd1bec45a3262/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.038341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9897665eef5470c80acccf6f87b8761, user_id=f6e2442eb4d94927a77bd1bec45a3262, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.041029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.107643 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1161/2293] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:33 2022] PUT /identity/v3/projects/a9897665eef5470c80acccf6f87b8761/users/f6e2442eb4d94927a77bd1bec45a3262/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:33.119401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.119688 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.119965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.148082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] MFA Rules not processed for user `f6e2442eb4d94927a77bd1bec45a3262`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:33.149341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:33.215393 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1133/2294] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:33.220004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.280898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d121f1-f887-4b29-863e-5c2d07a8579f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.285640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.286240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.286523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.286794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.287415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.289349 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.371070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1162/2295] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:33 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:33.375175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.385777 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc94b5-a417-4507-9307-fbb3b445c793 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.402475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:33.442268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.442872 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.443148 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.443443 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.444076 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.446182 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.541686 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1134/2296] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:33 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:33.545925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.556293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2c97e-e2c9-484e-82ff-a3ed32cacf1b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.562926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.563529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.563808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.564076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.564714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.566373 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.578106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1163/2297] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:33.582265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.592250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae14127-5d8c-471f-9c61-bfce2b9ab0aa admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.596859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.597567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.597848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.598128 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] PATH_INFO: `/v3/projects/42a0a68fb58b404398528fa27a06098c/users/7e6af4ac6fca48559fbe9d5fd0a898f4/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.613248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a0a68fb58b404398528fa27a06098c, user_id=7e6af4ac6fca48559fbe9d5fd0a898f4, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.615915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.691162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1135/2298] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:33 2022] PUT /identity/v3/projects/42a0a68fb58b404398528fa27a06098c/users/7e6af4ac6fca48559fbe9d5fd0a898f4/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:33.695150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.705245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f639b0e-32a6-4155-a78f-49b9b6d7f20f admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.761567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.762100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.762381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.762653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.763289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.764875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5f92-f0e8-4d0f-a9a5-510646aa4585 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.774487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1164/2299] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:33.778709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.789030 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38965e7-d612-4620-8c7b-bdb5f848919b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:33.794229 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:33.797015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.797015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.797015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] PATH_INFO: `/v3/projects/42a0a68fb58b404398528fa27a06098c/users/7e6af4ac6fca48559fbe9d5fd0a898f4/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.797434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a0a68fb58b404398528fa27a06098c, user_id=7e6af4ac6fca48559fbe9d5fd0a898f4, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:33.800069 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:33.811048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1136/2300] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:33 2022] PUT /identity/v3/projects/42a0a68fb58b404398528fa27a06098c/users/7e6af4ac6fca48559fbe9d5fd0a898f4/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:33.821082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:33.821399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:33.821669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:33.849585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] MFA Rules not processed for user `7e6af4ac6fca48559fbe9d5fd0a898f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:33.850801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:33.860545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:33.918145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1165/2301] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:33.929694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:33.931387 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:34.009376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119a85-fba6-44d6-8b0d-5618ff502ef6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:34.013119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:34.013761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:34.014104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:34.014441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:34.077435 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:34.078942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:34.087972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1137/2302] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:35.662337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:35.663780 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:35.727953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ecf63-484a-4c25-aaf3-a2792f1ea0f8 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:35.732498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:35.733151 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:35.733433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:35.733705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] PATH_INFO: `/v3/users/1754427925ab41419cb341f03d26b978` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:35.734819 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1754427925ab41419cb341f03d26b978)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:35.736728 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:35.800782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:35.809911 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63921940-0f74-4997-a268-5d639d858a7d service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:35.813823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:35.814419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:35.814699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:35.814973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:35.824593 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:35.826049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c5c59-6bbd-4a61-ae73-66706d497893 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:35.835402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1138/2303] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:35.950024 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1754427925ab41419cb341f03d26b978'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:35.957196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1754427925ab41419cb341f03d26b978'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:35.969203 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1754427925ab41419cb341f03d26b978'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:35.969872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1754427925ab41419cb341f03d26b978'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.021865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1754427925ab41419cb341f03d26b978'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.028538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1166/2304] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:35 2022] DELETE /identity/v3/users/1754427925ab41419cb341f03d26b978 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:36.037796 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:36.038079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:36.038713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:36.060669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:36.061965 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:36.070478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:36.119717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1139/2305] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:36.130064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:36.137544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:36.162093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:36.189271 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d1c763-d4f3-44a8-852e-101919fee60e admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:36.193025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:36.193658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:36.193938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:36.194209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:36.203137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:36.204571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:36.213886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1167/2306] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:36.611992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:36.613549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:36.625616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa6237-6e7e-4d9a-b776-8fb617763467 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:36.630388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:36.631016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:36.631293 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:36.631568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] PATH_INFO: `/v3/projects/f30d660fa19f4fa096a377ca4ded4616` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:36.632681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f30d660fa19f4fa096a377ca4ded4616)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:36.634684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:36.730305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f30d660fa19f4fa096a377ca4ded4616', 'request_id': 'req-17b7227c-653e-4a01-adc5-b64c478c55b6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.735747 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f30d660fa19f4fa096a377ca4ded4616', 'request_id': 'req-17b7227c-653e-4a01-adc5-b64c478c55b6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.742073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f30d660fa19f4fa096a377ca4ded4616', 'request_id': 'req-17b7227c-653e-4a01-adc5-b64c478c55b6'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.820506 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] The token cache is being invalidate because project f30d660fa19f4fa096a377ca4ded4616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:36.821113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.821818 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:36.823338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1140/2307] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:36 2022] DELETE /identity/v3/projects/f30d660fa19f4fa096a377ca4ded4616 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:36.827947 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:36.837597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0137c030-b7fe-49c7-9e38-1e27d9a50087 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:36.893230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:36.893859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:36.894144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:36.894422 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] PATH_INFO: `/v3/users/5ac226f017934df0bcc41b2a3eb83090` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:36.895544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ac226f017934df0bcc41b2a3eb83090)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:36.897506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:37.046508 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ac226f017934df0bcc41b2a3eb83090'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.053561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ac226f017934df0bcc41b2a3eb83090'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.066615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ac226f017934df0bcc41b2a3eb83090'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.067313 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ac226f017934df0bcc41b2a3eb83090'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.112960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ac226f017934df0bcc41b2a3eb83090'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.119429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1168/2308] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:36 2022] DELETE /identity/v3/users/5ac226f017934df0bcc41b2a3eb83090 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:37.583339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:37.584787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:37.598006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7227c-653e-4a01-adc5-b64c478c55b6 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:37.655397 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:37.656038 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:37.656321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:37.656595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] PATH_INFO: `/v3/projects/645d255f816f4046a5222b373f7d3288` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:37.657746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=645d255f816f4046a5222b373f7d3288)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:37.659678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:37.789302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:37.797014 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645d255f816f4046a5222b373f7d3288', 'request_id': 'req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.802735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645d255f816f4046a5222b373f7d3288', 'request_id': 'req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.809272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645d255f816f4046a5222b373f7d3288', 'request_id': 'req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.865857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] The token cache is being invalidate because project 645d255f816f4046a5222b373f7d3288 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:37.866467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.866769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:37.868385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1141/2309] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:37 2022] DELETE /identity/v3/projects/645d255f816f4046a5222b373f7d3288 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:37.872467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:37.873934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:37.886722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facfa3a3-9a4f-4caf-8808-d0b75bd59524 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:37.931709 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:37.944382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:37.945004 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:37.945311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:37.945581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] PATH_INFO: `/v3/users/d1e1a22548574a98bc9ad89199f549ec` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:37.946711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e1a22548574a98bc9ad89199f549ec)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:37.948610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:38.137928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e1a22548574a98bc9ad89199f549ec'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.144688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e1a22548574a98bc9ad89199f549ec'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.157101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e1a22548574a98bc9ad89199f549ec'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.157822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e1a22548574a98bc9ad89199f549ec'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.237909 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11a372a9-adbc-4e67-859d-caa050c57702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e1a22548574a98bc9ad89199f549ec'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.244056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1169/2310] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:37 2022] DELETE /identity/v3/users/d1e1a22548574a98bc9ad89199f549ec => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:38.640180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:38.641696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:38.655274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5b878-9b79-4ca5-a5c0-b4bc944b55eb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:38.713607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:38.714200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:38.714476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:38.714760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] PATH_INFO: `/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:38.715877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bd1556f26bd4634bf0973f494b1e7f7)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:38.717897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:38.791811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bd1556f26bd4634bf0973f494b1e7f7', 'request_id': 'req-8a2da1eb-7183-4730-83ec-ef55b263b473'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.797887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bd1556f26bd4634bf0973f494b1e7f7', 'request_id': 'req-8a2da1eb-7183-4730-83ec-ef55b263b473'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.803918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bd1556f26bd4634bf0973f494b1e7f7', 'request_id': 'req-8a2da1eb-7183-4730-83ec-ef55b263b473'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.861335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] The token cache is being invalidate because project 2bd1556f26bd4634bf0973f494b1e7f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:38.861716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.862550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8a2da1eb-7183-4730-83ec-ef55b263b473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:38.864220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1142/2311] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:38 2022] DELETE /identity/v3/projects/2bd1556f26bd4634bf0973f494b1e7f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:38.869095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:38.869418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:38.869693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:38.890092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:38.891307 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:38.952574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1170/2312] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:38.960558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:38.961008 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:38.962498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:38.981270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:38.982361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:38.990350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1143/2313] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:38.994586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.004829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4e92-f60f-4993-afd8-add41c11f28f None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.009466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.010057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.010337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.010613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.011277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:39.011604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.013248 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.024795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1171/2314] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:39.029221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.038665 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4156fc-b615-4951-9ea5-813387c5f07b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.044649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.045286 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.045568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.045840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.046512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.048428 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.142427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1144/2315] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:39.149771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.159862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab82da9-ecfa-40c4-8bbf-cd9835a8bceb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.210678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:39.218147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.218754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.219038 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.219314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.219943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.221922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.278896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1172/2316] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:39 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:39.283020 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.294316 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a523b48-58f5-43e9-89bd-41eca50630f1 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.299186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.299785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.300055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.300323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.300960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.302670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.312758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1145/2317] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:39.317032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.330240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147eddc5-7975-403f-8e18-aa5aab8bdb62 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.334908 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.337210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.337210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.337210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.337210 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.338276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a6dc-4201-4a2b-acb4-347761b3ad9c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.349512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1173/2318] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:39.353828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.364931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fc25e-44e7-47f4-8eb6-765fff0e7fa0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.369874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.370684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.370963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.371238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] PATH_INFO: `/v3/projects/7c47a3c27bbf4def8571198d3bce8844/users/eb904c5d24ad481ab94d5c40ebfe8fce/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.392419 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c47a3c27bbf4def8571198d3bce8844, user_id=eb904c5d24ad481ab94d5c40ebfe8fce, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.395169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.397639 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:39.494146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1146/2319] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:39 2022] PUT /identity/v3/projects/7c47a3c27bbf4def8571198d3bce8844/users/eb904c5d24ad481ab94d5c40ebfe8fce/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:39.506458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.506779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.507071 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.535604 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] MFA Rules not processed for user `eb904c5d24ad481ab94d5c40ebfe8fce`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:39.536755 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:39.601261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1174/2320] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:39.612938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.614676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:39.672898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541e62-4110-461c-8f55-bf663a5dff4a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.676567 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.677195 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.677480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.677751 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.686828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.691576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d65b95-e61e-404f-83ea-96cdf74ec62a service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.697083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1147/2321] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:39.721703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:39.784840 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c9e53-b2f8-4730-a4a7-93c88b89aa2b None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:39.789521 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:39.790089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:39.790364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:39.790633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] PATH_INFO: `/v3/users/eb904c5d24ad481ab94d5c40ebfe8fce` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:39.791749 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb904c5d24ad481ab94d5c40ebfe8fce)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:39.793699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:39.953911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb904c5d24ad481ab94d5c40ebfe8fce'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:39.960925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb904c5d24ad481ab94d5c40ebfe8fce'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:39.968514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:39.973950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb904c5d24ad481ab94d5c40ebfe8fce'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:39.974629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb904c5d24ad481ab94d5c40ebfe8fce'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.042832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb904c5d24ad481ab94d5c40ebfe8fce'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.048844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1175/2322] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:39 2022] DELETE /identity/v3/users/eb904c5d24ad481ab94d5c40ebfe8fce => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:40.053576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.054054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.054188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.075232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:40.076476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.133476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1148/2323] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:40.143746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:40.145171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.204705 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4807902c-d979-4fdf-b052-95147adc4bb6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:40.208489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:40.209102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.209415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.209691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.219047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:40.220522 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50430f1-857d-4eb5-9dfd-5625a5058f02 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:40.223467 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:40.224857 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.230531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1176/2324] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:40.236840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468efb8-2301-4c61-9c73-c3fdf4e6f3c0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:40.241511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:40.242140 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.242458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.242736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] PATH_INFO: `/v3/users/f6e2442eb4d94927a77bd1bec45a3262` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.243875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e2442eb4d94927a77bd1bec45a3262)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:40.246348 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:40.469178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e2442eb4d94927a77bd1bec45a3262'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.476793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e2442eb4d94927a77bd1bec45a3262'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.477526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e2442eb4d94927a77bd1bec45a3262'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.564312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e2442eb4d94927a77bd1bec45a3262'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.577402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e2442eb4d94927a77bd1bec45a3262'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:40.583394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1149/2325] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:40 2022] DELETE /identity/v3/users/f6e2442eb4d94927a77bd1bec45a3262 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:40.587875 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.588160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.588429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.607946 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:40.609163 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.671586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1177/2326] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:40.681224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:40.683301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.694708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:40.743314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b5b621-dd35-4a43-ba0e-18ea21a4566b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:40.747814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:40.748694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.748694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.748973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.758263 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:40.759710 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37ec22-cda1-4418-bb25-1c5753ef0312 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:40.769390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1150/2327] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:40.889834 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:40.891527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:40.906672 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32124b23-7eea-43d3-9323-82637d42a587 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:40.912084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:40.912783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:40.913062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:40.913361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] PATH_INFO: `/v3/projects/7c47a3c27bbf4def8571198d3bce8844` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:40.915395 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c47a3c27bbf4def8571198d3bce8844)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:40.921454 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.039924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c47a3c27bbf4def8571198d3bce8844', 'request_id': 'req-c49d09c7-edee-4111-aaf2-1d2511e11a23'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.047117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c47a3c27bbf4def8571198d3bce8844', 'request_id': 'req-c49d09c7-edee-4111-aaf2-1d2511e11a23'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.107117 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c47a3c27bbf4def8571198d3bce8844', 'request_id': 'req-c49d09c7-edee-4111-aaf2-1d2511e11a23'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.119310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] The token cache is being invalidate because project 7c47a3c27bbf4def8571198d3bce8844 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:41.119607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.120276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c49d09c7-edee-4111-aaf2-1d2511e11a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.121799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1178/2328] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:40 2022] DELETE /identity/v3/projects/7c47a3c27bbf4def8571198d3bce8844 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:41.126720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.127210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.127372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.147303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:41.148510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.210339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1151/2329] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:41.218601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.218890 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.219173 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.238742 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:41.239963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.247904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1179/2330] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:41.252206 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.256860 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.259063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.262469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a7f952-bb99-423e-a324-4b4513ed8469 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.266761 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:41.271995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.271995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.271995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.271995 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.272711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:41.272711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.272711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.272977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0c270-cc7f-4668-bf72-e0b3b36dfd6d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.279601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.280253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.280543 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.281299 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] PATH_INFO: `/v3/projects/a9897665eef5470c80acccf6f87b8761` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.283008 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9897665eef5470c80acccf6f87b8761)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.284360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1152/2331] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:41.285327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.288921 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.299863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c53123-b409-4e44-a0b8-93591565af0c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.304558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.305191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.305474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.305749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.306381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.308352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.409083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1153/2332] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:41 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:41.410131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.419676 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9897665eef5470c80acccf6f87b8761', 'request_id': 'req-46e41759-4d0b-47df-8f52-3d3b9140c593'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.426516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9897665eef5470c80acccf6f87b8761', 'request_id': 'req-46e41759-4d0b-47df-8f52-3d3b9140c593'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.466738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9897665eef5470c80acccf6f87b8761', 'request_id': 'req-46e41759-4d0b-47df-8f52-3d3b9140c593'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.474562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3d5d3-02ef-44aa-982d-455ff781d2d0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.478382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] The token cache is being invalidate because project a9897665eef5470c80acccf6f87b8761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:41.478551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.479122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.481368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.481368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.481368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.481368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.481859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1180/2333] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:41 2022] DELETE /identity/v3/projects/a9897665eef5470c80acccf6f87b8761 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:41.481949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.483732 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.485278 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.486729 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.548114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1154/2334] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:41 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:41.551727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.552025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e41759-4d0b-47df-8f52-3d3b9140c593 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.553471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.556601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.557261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.557566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.557842 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] PATH_INFO: `/v3/users/7e6af4ac6fca48559fbe9d5fd0a898f4` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.558975 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6af4ac6fca48559fbe9d5fd0a898f4)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.561322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.566185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5cb91-1539-4c68-a9bf-bce88c747627 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.571134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.571850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.572246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.572520 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.573324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.575043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.576405 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:41.586306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1155/2335] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:41.590719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.600429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d710c-90d6-4e5c-b6e7-bc8aaf948c43 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.605840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.612474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.612474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.612474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.612474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.612474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.619289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1156/2336] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:41.623063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.632544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b45f63c-bf26-4210-9b7e-ae02417ac37f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:41.637554 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:41.638489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.639133 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.639470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] PATH_INFO: `/v3/projects/1c7d8bc71c224834a8587db474a24816/users/52ef1c7a0247407695c4d08666ffdf16/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.654224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c7d8bc71c224834a8587db474a24816, user_id=52ef1c7a0247407695c4d08666ffdf16, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:41.656854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b386435e-5c82-4b98-a6f0-8b84086ab2b5 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:41.775336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1157/2337] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:41 2022] PUT /identity/v3/projects/1c7d8bc71c224834a8587db474a24816/users/52ef1c7a0247407695c4d08666ffdf16/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:41.786391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:41.786689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:41.786969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:41.801428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6af4ac6fca48559fbe9d5fd0a898f4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.809220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6af4ac6fca48559fbe9d5fd0a898f4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.832192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6af4ac6fca48559fbe9d5fd0a898f4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.836098 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6af4ac6fca48559fbe9d5fd0a898f4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.836214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] MFA Rules not processed for user `52ef1c7a0247407695c4d08666ffdf16`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:41.836214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.904831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1158/2338] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:47:41.911072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6af4ac6fca48559fbe9d5fd0a898f4'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:41.916446 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:41.917849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:41.919879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1181/2339] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:41 2022] DELETE /identity/v3/users/7e6af4ac6fca48559fbe9d5fd0a898f4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:41.982414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2afb8e-62a4-4161-8e15-1da05a70145f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:42.035814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:42.036487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.036766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.037043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.056578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:42.102527 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:42.104817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb0c0e8-a1d3-4561-b045-8606615ecd45 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:42.114385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1159/2340] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:47:42.358047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:42.359629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:42.378845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:42.443687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf640ade-694c-4dd0-86a4-0c921eacc359 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:42.448305 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:42.448942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.449236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.449544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] PATH_INFO: `/v3/projects/42a0a68fb58b404398528fa27a06098c` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.450618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a0a68fb58b404398528fa27a06098c)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:42.452566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:42.592584 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a0a68fb58b404398528fa27a06098c', 'request_id': 'req-bba041e4-72c5-4d34-942b-71e6b2c30fe9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:42.598847 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a0a68fb58b404398528fa27a06098c', 'request_id': 'req-bba041e4-72c5-4d34-942b-71e6b2c30fe9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:42.689335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a0a68fb58b404398528fa27a06098c', 'request_id': 'req-bba041e4-72c5-4d34-942b-71e6b2c30fe9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:42.703221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] The token cache is being invalidate because project 42a0a68fb58b404398528fa27a06098c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:42.703221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:42.703689 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-bba041e4-72c5-4d34-942b-71e6b2c30fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:42.705335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1182/2341] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:42 2022] DELETE /identity/v3/projects/42a0a68fb58b404398528fa27a06098c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:42.710690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.711151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.711270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.731150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:42.732349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:42.792723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1160/2342] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:42.800475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.800829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.801111 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.820872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:42.822124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:42.830379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1183/2343] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:42.834526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:42.844999 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ce04d9-96de-4d3f-9a2a-1689f4bd2ca7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:42.852589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:42.852589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.852589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.852589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.852912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:42.852912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:42.853831 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:42.865955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1161/2344] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:42.870379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:42.880217 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeac9ae-79c3-4791-85b7-47d57ebd6d4e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:42.885744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:42.886858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:42.886858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:42.886858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:42.887467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:42.889384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:42.983386 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1184/2345] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:42 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:42.986586 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:42.997305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65698f16-677b-4e24-9326-bfb116fbf579 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.052944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.053590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.053876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.054150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.054794 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.056750 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.145822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1162/2346] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:42 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:47:43.149915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.161242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0ed8-5c4c-4672-b95e-0914bead952b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.165991 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.166598 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.166881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.167157 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.167830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.169472 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.179449 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1185/2347] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:43.184003 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.194517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b77e7e7-0106-42cf-af58-f649517a488a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.199787 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.200380 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.200661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.200934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.201617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.203199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4e414-cfab-4cb3-9d64-100498459309 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.213895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1163/2348] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:43.217930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.228128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b44ed-3e97-4d46-9ec6-14aef7157010 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.232788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.233501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.233783 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.234061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] PATH_INFO: `/v3/projects/b273dc3c878343a99d6eca2db9541a89/users/cfb5857912f941cba2eb9db0d1e1ae33/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.249281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b273dc3c878343a99d6eca2db9541a89, user_id=cfb5857912f941cba2eb9db0d1e1ae33, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.251971 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.324516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1186/2349] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:43 2022] PUT /identity/v3/projects/b273dc3c878343a99d6eca2db9541a89/users/cfb5857912f941cba2eb9db0d1e1ae33/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:43.336044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.336336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.336617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.364904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] MFA Rules not processed for user `cfb5857912f941cba2eb9db0d1e1ae33`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:43.366161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:43.379771 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:43.431211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1164/2350] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:43.439136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.472392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:43.501593 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30567e00-4e49-46da-a11f-0ed331a641bc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.506283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.506950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.507226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.507499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.508121 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.510096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.613394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1187/2351] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:43 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:43.616318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.633301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f9846-95b4-48cb-9bc2-a4aa6aa7b956 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.704681 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.705314 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.705600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.705874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.706569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.708561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.806524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1165/2352] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:43 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:43.808382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.818933 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47a618-c203-49cc-a5b2-c2e5e4112484 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.823551 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.824152 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.824432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.824703 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.825488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.827090 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.837084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1188/2353] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:43.841512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.851649 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf96a0e-17e8-4d96-9439-d03ff5dd6726 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.856978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.857613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.857895 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.858169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.858812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.860410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a616ae37-0bf1-45d9-9d94-98fbecbee169 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.873508 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1166/2354] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:43.874722 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:43.884815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce985-d5f2-4f46-aa61-956a61ac8e54 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:43.889714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:43.890367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.890681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.890955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] PATH_INFO: `/v3/projects/ea89b3581bbf47a086a402a6db3728f7/users/6f74b3040a804b6b9794a3c1228f2a6e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:43.906527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea89b3581bbf47a086a402a6db3728f7, user_id=6f74b3040a804b6b9794a3c1228f2a6e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:43.909286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:43.987763 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1189/2355] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:43 2022] PUT /identity/v3/projects/ea89b3581bbf47a086a402a6db3728f7/users/6f74b3040a804b6b9794a3c1228f2a6e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:43.998047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:43.998307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:43.998589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.027748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] MFA Rules not processed for user `6f74b3040a804b6b9794a3c1228f2a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:44.028988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:44.096541 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1167/2356] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:44.101184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.165534 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032423d1-f977-457f-aa7d-938140fffc70 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.170183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.170786 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.171070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.171343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.172084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.173997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.286567 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1190/2357] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:44 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:44.290271 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.303108 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49550c-daf2-46a8-a1a9-c3c3813e939b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.330544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:44.375166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.375781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.376062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.376332 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.376968 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.379056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.461652 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1168/2358] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:44 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:44.466352 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.476919 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ed6510-da43-4646-95e3-3c4cb54c140b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.482774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.487924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.487924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.487924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.487924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.487924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.498529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1191/2359] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:44.502614 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.514089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54daedf4-2309-4a00-afe2-77b6f33ad171 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.522497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.523469 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.523752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.524022 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] PATH_INFO: `/v3/projects/129ec669b5e14e80ba214916a4a055dc/users/4d546ab5ad7747fbb49e071a342a6038/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.542985 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ec669b5e14e80ba214916a4a055dc, user_id=4d546ab5ad7747fbb49e071a342a6038, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.547303 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.659563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1169/2360] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:44 2022] PUT /identity/v3/projects/129ec669b5e14e80ba214916a4a055dc/users/4d546ab5ad7747fbb49e071a342a6038/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:44.663461 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.679916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ce4a91-6e12-45b3-a24c-5b51732e0928 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.778653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:44.797974 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.799076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.799076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.799350 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.799788 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.801430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fddaffd-31a7-4449-8b62-601ae0aa3380 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.814325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1192/2361] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:44.818522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.830878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967997a-2700-4632-9f31-e679a9c4bf93 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:44.836496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:44.837366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.837749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.838095 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] PATH_INFO: `/v3/projects/129ec669b5e14e80ba214916a4a055dc/users/4d546ab5ad7747fbb49e071a342a6038/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.840550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ec669b5e14e80ba214916a4a055dc, user_id=4d546ab5ad7747fbb49e071a342a6038, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:44.843660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:44.867210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1170/2362] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:44 2022] PUT /identity/v3/projects/129ec669b5e14e80ba214916a4a055dc/users/4d546ab5ad7747fbb49e071a342a6038/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:44.878311 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:44.878658 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:44.878878 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:44.909290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] MFA Rules not processed for user `4d546ab5ad7747fbb49e071a342a6038`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:44.910542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:44.980432 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1193/2363] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:44.991497 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:44.993746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:45.059115 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc301348-d4cb-475c-a471-9ebb9eef71a4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:45.063097 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:45.063709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:45.063992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:45.064265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:45.074025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:45.075400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:45.086590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1171/2364] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:46.145506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:46.156214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f9e53-c406-4acf-88c2-b9a39c7a65db None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:46.160339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:46.168490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:46.168490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:46.168490 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:46.218997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:46.220428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf429ba-f71c-4ce0-876b-dcbeda987aa4 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:46.229879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1194/2365] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:46 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:48.005058 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:48.006513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:48.097748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4b7a9-3607-4280-911f-aba2efc77ac0 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:48.102453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:48.103109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:48.103394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:48.104199 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] PATH_INFO: `/v3/users/52ef1c7a0247407695c4d08666ffdf16` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:48.105436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef1c7a0247407695c4d08666ffdf16)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:48.107906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:48.130551 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:48.359209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef1c7a0247407695c4d08666ffdf16'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:48.366137 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef1c7a0247407695c4d08666ffdf16'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:48.366802 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef1c7a0247407695c4d08666ffdf16'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:48.430754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef1c7a0247407695c4d08666ffdf16'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:48.444145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef1c7a0247407695c4d08666ffdf16'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:48.450757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1172/2366] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:48 2022] DELETE /identity/v3/users/52ef1c7a0247407695c4d08666ffdf16 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:47:48.455482 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:48.455968 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:48.456076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:48.474894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:48.476130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:48.536517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1195/2367] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:48.546782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:48.551568 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:48.608532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4d8fe9-f694-4b60-b2c3-6dfdcd7942d9 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:48.612127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:48.612727 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:48.613005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:48.613296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:48.622748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:48.624163 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:48.633509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1173/2368] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:49.107180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:49.108596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:49.121158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4970c5-0083-4822-ad27-9f6b2c5b9274 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:49.125816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:49.126448 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:49.126723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:49.126994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] PATH_INFO: `/v3/projects/1c7d8bc71c224834a8587db474a24816` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:49.128186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c7d8bc71c224834a8587db474a24816)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:49.130329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:49.141727 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:49.230992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7d8bc71c224834a8587db474a24816', 'request_id': 'req-f0043313-6da1-45c5-8801-1cb5c800aba0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:49.237362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7d8bc71c224834a8587db474a24816', 'request_id': 'req-f0043313-6da1-45c5-8801-1cb5c800aba0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:49.304531 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7d8bc71c224834a8587db474a24816', 'request_id': 'req-f0043313-6da1-45c5-8801-1cb5c800aba0'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:49.317854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] The token cache is being invalidate because project 1c7d8bc71c224834a8587db474a24816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:49.318149 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:49.318850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:49.320970 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1196/2369] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:49 2022] DELETE /identity/v3/projects/1c7d8bc71c224834a8587db474a24816 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:49.546623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:49.548685 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:49.561943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729e91-59df-4423-a1a5-36db55371bac service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:49.613502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:49.614033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:49.614308 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:49.614576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:49.616462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:49.668958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:49.680705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:49.682934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:49.693139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1174/2370] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:51.385852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:51.387399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:51.467327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0043313-6da1-45c5-8801-1cb5c800aba0 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:51.472239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:51.472939 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:51.473253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:51.473688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:51.475930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:51.565561 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:51.567124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:51.579477 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1197/2371] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:51 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:53.219056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:53.220533 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:53.301709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3852024-0e63-4985-9d25-de43251a105a service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:53.307558 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:53.308156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:53.308431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:53.308969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:53.310876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:53.323400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:53.325298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:53.337491 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1175/2372] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:53.342982 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:53.344736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:53.360348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6806493-c359-449e-8d7c-29238f3dcc6b service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:53.364841 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:53.365629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:53.365915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:53.366185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] PATH_INFO: `/v3/users/a50d4e2b72a045b0bf1e9afad975e1fa` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:53.367392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50d4e2b72a045b0bf1e9afad975e1fa)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:53.369962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:53.564719 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50d4e2b72a045b0bf1e9afad975e1fa'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:53.566031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:53.572404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50d4e2b72a045b0bf1e9afad975e1fa'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:53.584591 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50d4e2b72a045b0bf1e9afad975e1fa'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:53.585544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50d4e2b72a045b0bf1e9afad975e1fa'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:53.682769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-0b62e074-8d14-415f-a21a-99e63e483a9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50d4e2b72a045b0bf1e9afad975e1fa'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:53.691304 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1198/2373] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:53 2022] DELETE /identity/v3/users/a50d4e2b72a045b0bf1e9afad975e1fa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:53.934251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:53.945928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99edfd39-a880-4059-8b50-6c220a7c90be service placement] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.004141 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.004776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.005057 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.005365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] PATH_INFO: `/v3/projects/426500481e9a4eb8bfb893023988a0c9` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.006483 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=426500481e9a4eb8bfb893023988a0c9)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.008409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.161890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '426500481e9a4eb8bfb893023988a0c9', 'request_id': 'req-395b6017-e384-46db-811c-96225389d6b1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:54.167403 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '426500481e9a4eb8bfb893023988a0c9', 'request_id': 'req-395b6017-e384-46db-811c-96225389d6b1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:54.173636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '426500481e9a4eb8bfb893023988a0c9', 'request_id': 'req-395b6017-e384-46db-811c-96225389d6b1'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:54.246460 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] The token cache is being invalidate because project 426500481e9a4eb8bfb893023988a0c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:54.247034 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:54.247282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-395b6017-e384-46db-811c-96225389d6b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:54.248877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1176/2374] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:53 2022] DELETE /identity/v3/projects/426500481e9a4eb8bfb893023988a0c9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:54.253833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.254115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.254390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.274409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:54.276181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:54.342329 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1199/2375] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:54.350291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.350672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.351082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.378012 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:54.379358 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:54.388655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1177/2376] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:54.392862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.402426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e97a7-445f-43b6-a387-2cd6fc6d4c79 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.407343 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.407953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.408242 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.408516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.409188 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:54.409500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.411132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.426180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1200/2377] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:47:54.427509 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.435033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:54.438458 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3853b-7c70-406a-85f4-03397efcafba None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.443334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.443938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.444224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.446608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.446608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.447699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.570203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1178/2378] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:54 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:54.575030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.585401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30f9391-7c28-4694-9027-fdcf7d41a1ee admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.642053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.642657 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.642942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.643218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.643857 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.645829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.798428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1201/2379] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:54 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:54.802455 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.818808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd6246d-adbb-4ceb-9d7d-db596f50bc7d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.830510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.830510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.830510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.830510 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.830933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.830933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.839943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1179/2380] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:47:54.843999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.855138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834044-a997-4471-a764-9f8b0ff958fc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.859957 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.860564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.860846 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.861132 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.861792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.863415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318aa5f-319b-439c-99ba-f562b6a65213 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.875263 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1202/2381] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:47:54.879676 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:54.890168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb181a-4ada-498d-a80d-04f34f90e5c3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:54.894758 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:54.895414 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.895698 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.895973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] PATH_INFO: `/v3/projects/d82855b9e6004a888923fe62fbbb0377/users/b0c20a3a784141b1b4ea4a314f26bc7b/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:54.911201 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82855b9e6004a888923fe62fbbb0377, user_id=b0c20a3a784141b1b4ea4a314f26bc7b, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:54.919556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:54.980300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1180/2382] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:47:54 2022] PUT /identity/v3/projects/d82855b9e6004a888923fe62fbbb0377/users/b0c20a3a784141b1b4ea4a314f26bc7b/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:54.985423 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:54.985711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:54.986026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:55.004953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:55.006984 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:55.032260 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:55.066924 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1203/2383] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:55.076708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:55.078399 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:55.138338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485a94c-d541-4ea8-81bf-c09acdb0a6ee admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:55.142074 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:55.143331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:55.143331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:55.143331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:55.152833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:55.154307 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dd700-8b75-4228-b08a-532e6dff40fa service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:55.163752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1181/2384] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:55.761965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:55.763370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:55.775288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93795fb-acc8-4fd4-9651-74aa0edd3c45 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:55.779943 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:55.780556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:55.780833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:55.781103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] PATH_INFO: `/v3/users/cfb5857912f941cba2eb9db0d1e1ae33` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:55.783167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb5857912f941cba2eb9db0d1e1ae33)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:55.784396 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:55.972181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb5857912f941cba2eb9db0d1e1ae33'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:55.980145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb5857912f941cba2eb9db0d1e1ae33'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:55.994646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb5857912f941cba2eb9db0d1e1ae33'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:55.995404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb5857912f941cba2eb9db0d1e1ae33'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:56.042231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb5857912f941cba2eb9db0d1e1ae33'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:56.050388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1204/2385] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:55 2022] DELETE /identity/v3/users/cfb5857912f941cba2eb9db0d1e1ae33 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:56.054707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:56.055250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:56.055979 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:56.086534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:56.089542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:56.154047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1182/2386] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:56.163550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:56.164950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:56.225746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157525f-8f95-4971-b393-ad0ede2e6a7a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:56.230080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:56.230687 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:56.230976 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:56.231253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:56.240653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:56.242179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:56.253583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1205/2387] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:47:56.737394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:56.739060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:56.752923 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b10c35-a069-4cfb-ba68-fa6e15c0d444 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:56.757939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:56.759411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:56.759411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:56.759411 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] PATH_INFO: `/v3/projects/b273dc3c878343a99d6eca2db9541a89` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:56.760752 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b273dc3c878343a99d6eca2db9541a89)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:56.762972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:56.885855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:56.889098 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b273dc3c878343a99d6eca2db9541a89', 'request_id': 'req-be6024d9-7554-4c06-b2ab-f620af57cc39'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:56.895291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b273dc3c878343a99d6eca2db9541a89', 'request_id': 'req-be6024d9-7554-4c06-b2ab-f620af57cc39'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:56.903504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b273dc3c878343a99d6eca2db9541a89', 'request_id': 'req-be6024d9-7554-4c06-b2ab-f620af57cc39'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.005616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] The token cache is being invalidate because project b273dc3c878343a99d6eca2db9541a89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:57.005823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.006548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.008327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1183/2388] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:56 2022] DELETE /identity/v3/projects/b273dc3c878343a99d6eca2db9541a89 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:57.013053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:57.023285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc3a177-e469-4b7a-83f1-6d0233188f0d service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:57.075398 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:57.089476 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:57.091354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:57.091354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:57.091354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] PATH_INFO: `/v3/users/6f74b3040a804b6b9794a3c1228f2a6e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:57.092009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f74b3040a804b6b9794a3c1228f2a6e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:57.094081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:57.323258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f74b3040a804b6b9794a3c1228f2a6e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.334294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f74b3040a804b6b9794a3c1228f2a6e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.347779 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f74b3040a804b6b9794a3c1228f2a6e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.348571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f74b3040a804b6b9794a3c1228f2a6e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.419237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f74b3040a804b6b9794a3c1228f2a6e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:57.426316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1206/2389] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:57 2022] DELETE /identity/v3/users/6f74b3040a804b6b9794a3c1228f2a6e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:58.055180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:58.056711 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:58.070538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6024d9-7554-4c06-b2ab-f620af57cc39 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:58.136215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:58.136878 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:58.137245 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:58.137511 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] PATH_INFO: `/v3/projects/ea89b3581bbf47a086a402a6db3728f7` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:58.138736 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea89b3581bbf47a086a402a6db3728f7)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:58.140679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:58.275437 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea89b3581bbf47a086a402a6db3728f7', 'request_id': 'req-d12e6f3e-532e-47e5-a688-8701b6b90209'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.278897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea89b3581bbf47a086a402a6db3728f7', 'request_id': 'req-d12e6f3e-532e-47e5-a688-8701b6b90209'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.286479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea89b3581bbf47a086a402a6db3728f7', 'request_id': 'req-d12e6f3e-532e-47e5-a688-8701b6b90209'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.379764 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] The token cache is being invalidate because project ea89b3581bbf47a086a402a6db3728f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:58.380062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.383680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.383680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1184/2390] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:58 2022] DELETE /identity/v3/projects/ea89b3581bbf47a086a402a6db3728f7 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:58.387099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:58.388646 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:58.404621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a635a8-036c-44e0-8304-dd9b6d6abcb4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:58.469699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:58.470339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:58.470618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:58.470891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] PATH_INFO: `/v3/users/4d546ab5ad7747fbb49e071a342a6038` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:58.472021 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d546ab5ad7747fbb49e071a342a6038)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:58.473980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:58.655650 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d546ab5ad7747fbb49e071a342a6038'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.670145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d546ab5ad7747fbb49e071a342a6038'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.687618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:58.697850 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d546ab5ad7747fbb49e071a342a6038'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.698617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d546ab5ad7747fbb49e071a342a6038'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.802409 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-1cb7d135-fd27-46ff-a9a4-1a03a9202aae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d546ab5ad7747fbb49e071a342a6038'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:58.811262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1207/2391] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:47:58 2022] DELETE /identity/v3/users/4d546ab5ad7747fbb49e071a342a6038 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:59.318061 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:59.326735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:59.342805 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6f3e-532e-47e5-a688-8701b6b90209 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:59.426176 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:59.426824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:59.427104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:59.427429 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] PATH_INFO: `/v3/projects/129ec669b5e14e80ba214916a4a055dc` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:59.428678 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=129ec669b5e14e80ba214916a4a055dc)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:59.430803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:59.438650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:59.545050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129ec669b5e14e80ba214916a4a055dc', 'request_id': 'req-22c724fd-ccd3-4d4d-a714-6786e352a458'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:59.550811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129ec669b5e14e80ba214916a4a055dc', 'request_id': 'req-22c724fd-ccd3-4d4d-a714-6786e352a458'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:59.558797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129ec669b5e14e80ba214916a4a055dc', 'request_id': 'req-22c724fd-ccd3-4d4d-a714-6786e352a458'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:59.636434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] The token cache is being invalidate because project 129ec669b5e14e80ba214916a4a055dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:47:59.636874 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:59.637655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-22c724fd-ccd3-4d4d-a714-6786e352a458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:47:59.639766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1185/2392] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:47:59 2022] DELETE /identity/v3/projects/129ec669b5e14e80ba214916a4a055dc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:47:59.645635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:59.646124 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:59.646265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:59.669815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:59.671296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:59.740471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1208/2393] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:59.748828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:59.749228 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:59.749545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:59.778300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:47:59.780175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:47:59.794722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1186/2394] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:47:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:47:59.800441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:59.806485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016373f-14f3-4b9d-848c-80c5faad902d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:59.811768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:59.812381 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:59.812656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:59.812930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:59.813683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:47:59.813980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:59.815623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:59.828820 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1209/2395] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:47:59.833849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:59.844372 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cbbbc9-7657-4453-8868-8eef59988462 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:47:59.849220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:47:59.850353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:47:59.850353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:47:59.850353 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:47:59.851445 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:47:59.853854 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:47:59.963730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1187/2396] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:47:59 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:47:59.968154 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:47:59.978962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dad94-a2f1-45c7-9380-f20732dd30b6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.042544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.043158 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.043443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.043713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.044354 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.046790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:00.141775 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1210/2397] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:47:59 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:00.145825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:00.157442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c26d1-0ac3-44bf-a6a3-a517f43217fc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.163052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.166759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.166759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.166759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.166759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.167719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:00.183906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1188/2398] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:00.188046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:00.199112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad417ce-376b-439c-a7a1-8f91035dbef8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.205801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.206798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.207153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.207498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.208281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.210185 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeecf9f-01c0-4eae-b666-369e232224eb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:00.222181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1211/2399] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:00.226550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:00.238462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5362b9f-7698-4649-8131-3fedca114856 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.243407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.247252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.247252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.247252 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] PATH_INFO: `/v3/projects/cdab4d3a5a0b482f8a8ddf949fe960c0/users/aadd6c05e4d64646bfae791beb265b5e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.259920 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdab4d3a5a0b482f8a8ddf949fe960c0, user_id=aadd6c05e4d64646bfae791beb265b5e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.262671 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:00.532434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1189/2400] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:00 2022] PUT /identity/v3/projects/cdab4d3a5a0b482f8a8ddf949fe960c0/users/aadd6c05e4d64646bfae791beb265b5e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:00.566683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.566683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.566683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.573781 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] MFA Rules not processed for user `aadd6c05e4d64646bfae791beb265b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:00.575037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:00.624622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:00.653876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1212/2401] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:00.659304 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:00.745322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57320c12-f9fb-4256-be3e-0599c904d0b3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.752091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.752930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.753355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.753902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.754945 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.757050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:00.877496 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1190/2402] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:48:00 2022] POST /identity/v3/projects => generated 377 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:00.881568 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:00.893863 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dddab1-b853-4db7-9226-d31f4035c2d9 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:00.985282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:00.986018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:00.986367 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:00.986797 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:00.987515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:00.989809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.118091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1213/2403] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:48:00 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:01.122813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.138234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b968a4b8-1720-4404-8b40-76dfad67e5e2 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.152404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.152404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.152404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.152404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.152780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.152780 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.165109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1191/2404] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:01.169345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.181893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29579241-8995-4cdf-93e7-cbbd93b84a0b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.191769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.192489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.192843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.193147 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.194497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.196412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac1834-b227-4b73-aefa-20c1c812d9b1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.209575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1214/2405] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:01.213608 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.221579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:01.226769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ea29-09b4-4156-8fcf-5fa27ec210b2 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.231342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.232112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.232493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.232873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] PATH_INFO: `/v3/projects/848456a1bc574af7b58526d6ecf7aa36/users/abf83b42d4914e5cab75e917c2e76c60/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.250989 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=848456a1bc574af7b58526d6ecf7aa36, user_id=abf83b42d4914e5cab75e917c2e76c60, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.257379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.363087 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1192/2406] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:01 2022] PUT /identity/v3/projects/848456a1bc574af7b58526d6ecf7aa36/users/abf83b42d4914e5cab75e917c2e76c60/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:01.374997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.375283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.375914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.410060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] MFA Rules not processed for user `abf83b42d4914e5cab75e917c2e76c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:01.412295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:01.510076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1215/2407] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:01.511767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.592013 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134681ec-b815-4c56-a233-946bc5d27f3b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.598063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.600667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.600667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.600667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.600667 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.603957 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248c40-d4d4-4d28-9c41-70362a75f88d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.716023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1193/2408] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:48:01 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:01.720829 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.747578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34732b-d5e8-4c93-9c00-5e03638d99c2 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.771250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7ba1d-02c8-4bd9-86f4-c1677136f044 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.771250 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7ba1d-02c8-4bd9-86f4-c1677136f044 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.771610 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7ba1d-02c8-4bd9-86f4-c1677136f044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.809453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-65a7ba1d-02c8-4bd9-86f4-c1677136f044 None None] MFA Rules not processed for user `b0c20a3a784141b1b4ea4a314f26bc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:01.814171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-65a7ba1d-02c8-4bd9-86f4-c1677136f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:01.832622 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:01.847669 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.848318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.848596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.848866 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.849578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.851585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:01.890451 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1194/2409] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:01.891718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2fdd4-e601-4c63-bcb7-e871f4e127b1 None None] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.892009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2fdd4-e601-4c63-bcb7-e871f4e127b1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.892288 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2fdd4-e601-4c63-bcb7-e871f4e127b1 None None] PATH_INFO: `/` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.893557 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1195/2410] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:48:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:48:01.899415 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.900265 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.900546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.920680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] MFA Rules not processed for user `2757d3bd0a47405bbf3ea97ecb3cf93a`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:01.921938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:01.947837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1216/2411] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:48:01 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:01.947837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.947837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:01.978877 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1196/2412] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:48:01.979765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:01.986696 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:01.991092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cccc58-fa59-4027-9efc-90f6e48c09c1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:01.995730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:01.997564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:01.997564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:01.997564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:01.997564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:01.999151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.009578 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1197/2413] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:02.010837 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.012613 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:02.025297 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76839c-3dff-48d0-9c13-c0bf6864c7c4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.029084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.029725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.030001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.030274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.035989 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ed709-0dfa-4cb7-bfcb-d8373f2a46f8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.038504 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.039939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.043230 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.043865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.044150 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.044618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.049576 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1198/2414] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:02.050470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.055996 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.059281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb29d5-90cb-4f4d-baba-7bfe8cd0a677 service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.072126 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14b920-32ed-48f1-84b2-cf1bb180db23 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.081320 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1217/2415] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:02.083324 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.084361 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.084544 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.084836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] PATH_INFO: `/v3/projects/849ed21b8b264b13bc7c59e32e4f192a/users/0cf2e1c1ba3942e9a153fdf95f88ad65/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.107278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849ed21b8b264b13bc7c59e32e4f192a, user_id=0cf2e1c1ba3942e9a153fdf95f88ad65, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.111987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.143006 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf428f-ba7f-492f-9774-06572a40f1be None None] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.143385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf428f-ba7f-492f-9774-06572a40f1be None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.143661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf428f-ba7f-492f-9774-06572a40f1be None None] PATH_INFO: `/` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.145014 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1218/2416] 10.222.0.50 () {54 vars in 921 bytes} [Wed Oct 12 12:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 12 12:48:02.150899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.151172 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.151438 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.171399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] MFA Rules not processed for user `cbb7f8775d5e4224a18fc0dd7a5f53b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:02.172624 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:02.181978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1219/2417] 10.222.0.50 () {58 vars in 1018 bytes} [Wed Oct 12 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:48:02.192666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.197591 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1199/2418] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:02 2022] PUT /identity/v3/projects/849ed21b8b264b13bc7c59e32e4f192a/users/0cf2e1c1ba3942e9a153fdf95f88ad65/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:02.201319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.204941 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734651ff-7316-4b5d-953d-ecef55a4c23d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.268095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.268791 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.269113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.269417 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.284594 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a1a50-65ba-48e9-80ba-4ec402574879 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.289526 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.290427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.290427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.290722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.291378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.292994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.303735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1200/2419] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:48:02.308006 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.323798 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb87357e-4e59-4c56-aa19-00f776b5f8f4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.329296 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.330185 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.331355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.331355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] PATH_INFO: `/v3/projects/849ed21b8b264b13bc7c59e32e4f192a/users/0cf2e1c1ba3942e9a153fdf95f88ad65/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.333192 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849ed21b8b264b13bc7c59e32e4f192a, user_id=0cf2e1c1ba3942e9a153fdf95f88ad65, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.335980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0e72-802e-40da-a7c4-3037d3f3fea1 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.354187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1201/2420] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:02 2022] PUT /identity/v3/projects/849ed21b8b264b13bc7c59e32e4f192a/users/0cf2e1c1ba3942e9a153fdf95f88ad65/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:48:02.366151 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.366789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.367146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.367266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.368777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.374628 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:02.387126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1220/2421] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 12 12:48:02.404763 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] MFA Rules not processed for user `0cf2e1c1ba3942e9a153fdf95f88ad65`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:02.408007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:02.484552 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1202/2422] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:48:02.496579 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.498296 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:02.573019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ae2c9-7b26-4345-a040-182bd2ef4f56 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.646583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.647213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.647498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.647771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.657965 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.659462 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701328d7-cdd5-4cde-8ade-0397337e1907 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.669547 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1221/2423] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:02.787715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:02.791799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:02.824587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8ad2b-23db-4503-bc58-27f489d4759a None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:02.829862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:02.830436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:02.830719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:02.831183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:02.877704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:02.939680 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:02.941556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:02.955391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1203/2424] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:04.794859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e406e-ca48-47ce-81df-bbf482ea2ec1 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:04.795406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e406e-ca48-47ce-81df-bbf482ea2ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:04.795564 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e406e-ca48-47ce-81df-bbf482ea2ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:04.820266 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-d08e406e-ca48-47ce-81df-bbf482ea2ec1 None None] MFA Rules not processed for user `b0c20a3a784141b1b4ea4a314f26bc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:04.821858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-d08e406e-ca48-47ce-81df-bbf482ea2ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:04.890616 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1222/2425] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:07.387661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:07.451702 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d07875-36a4-4083-9450-c6ef782a0640 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:07.456279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:07.456912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:07.457221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:07.457498 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] PATH_INFO: `/v3/users/aadd6c05e4d64646bfae791beb265b5e` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:07.458648 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadd6c05e4d64646bfae791beb265b5e)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:07.460574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:07.647410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadd6c05e4d64646bfae791beb265b5e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:07.655949 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadd6c05e4d64646bfae791beb265b5e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:07.656644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadd6c05e4d64646bfae791beb265b5e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:07.771341 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadd6c05e4d64646bfae791beb265b5e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:07.785687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadd6c05e4d64646bfae791beb265b5e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:07.792336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1204/2426] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:48:07 2022] DELETE /identity/v3/users/aadd6c05e4d64646bfae791beb265b5e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:07.797035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:07.797880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:07.798155 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:07.819554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:07.820770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:07.883195 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1223/2427] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:48:07.893913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:07.895391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:07.942370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:07.954388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185992e7-ac33-4a0c-bf91-561f1fd625dc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:07.958155 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:07.958765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:07.959052 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:07.959349 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:07.968423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:07.969891 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:07.979388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1205/2428] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:08.522302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:08.523750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:08.531501 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:08.543550 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832da827-bc17-4d43-b3ff-24d976109a61 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:08.548335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:08.548978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:08.549298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:08.549571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] PATH_INFO: `/v3/projects/cdab4d3a5a0b482f8a8ddf949fe960c0` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:08.550708 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdab4d3a5a0b482f8a8ddf949fe960c0)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:08.553426 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:08.682620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdab4d3a5a0b482f8a8ddf949fe960c0', 'request_id': 'req-911ad148-4ead-43ae-94dc-8b07cc178f43'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:08.691683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdab4d3a5a0b482f8a8ddf949fe960c0', 'request_id': 'req-911ad148-4ead-43ae-94dc-8b07cc178f43'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:08.790488 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdab4d3a5a0b482f8a8ddf949fe960c0', 'request_id': 'req-911ad148-4ead-43ae-94dc-8b07cc178f43'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:08.802282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] The token cache is being invalidate because project cdab4d3a5a0b482f8a8ddf949fe960c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:48:08.802926 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:08.803224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:08.804746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1224/2429] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:48:08 2022] DELETE /identity/v3/projects/cdab4d3a5a0b482f8a8ddf949fe960c0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:08.809302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:08.819253 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501911e-b5dd-4c52-a85c-efbd0c2fab7e service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:08.880080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:08.880636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:08.880973 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:08.881313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] PATH_INFO: `/v3/users/abf83b42d4914e5cab75e917c2e76c60` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:08.882487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf83b42d4914e5cab75e917c2e76c60)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:08.885102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:09.065600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf83b42d4914e5cab75e917c2e76c60'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.075532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf83b42d4914e5cab75e917c2e76c60'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.076376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf83b42d4914e5cab75e917c2e76c60'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.148677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf83b42d4914e5cab75e917c2e76c60'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.165502 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf83b42d4914e5cab75e917c2e76c60'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.172371 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1206/2430] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:48:08 2022] DELETE /identity/v3/users/abf83b42d4914e5cab75e917c2e76c60 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:09.722712 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:09.724688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:09.738276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ad148-4ead-43ae-94dc-8b07cc178f43 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:09.803898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:09.803898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:09.803898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:09.803898 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] PATH_INFO: `/v3/projects/848456a1bc574af7b58526d6ecf7aa36` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:09.805929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=848456a1bc574af7b58526d6ecf7aa36)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:09.808895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:09.893046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848456a1bc574af7b58526d6ecf7aa36', 'request_id': 'req-b3c246bd-ddbe-478b-a658-5865b58d3956'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.899782 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848456a1bc574af7b58526d6ecf7aa36', 'request_id': 'req-b3c246bd-ddbe-478b-a658-5865b58d3956'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:09.989690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848456a1bc574af7b58526d6ecf7aa36', 'request_id': 'req-b3c246bd-ddbe-478b-a658-5865b58d3956'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.001952 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] The token cache is being invalidate because project 848456a1bc574af7b58526d6ecf7aa36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:48:10.002241 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.002881 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.004382 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1225/2431] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:48:09 2022] DELETE /identity/v3/projects/848456a1bc574af7b58526d6ecf7aa36 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:10.008431 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:10.009932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:10.024242 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da284fee-dae3-4334-a6d0-06ae6cf3955f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:10.084661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:10.085395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:10.085684 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:10.085960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] PATH_INFO: `/v3/users/0cf2e1c1ba3942e9a153fdf95f88ad65` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:10.087637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf2e1c1ba3942e9a153fdf95f88ad65)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:10.089619 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:10.094251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:10.286897 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf2e1c1ba3942e9a153fdf95f88ad65'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.300485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf2e1c1ba3942e9a153fdf95f88ad65'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.301319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf2e1c1ba3942e9a153fdf95f88ad65'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.366722 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf2e1c1ba3942e9a153fdf95f88ad65'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.387172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-2e4188ce-2307-40ed-9e94-dc85263f54c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf2e1c1ba3942e9a153fdf95f88ad65'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:10.393294 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1207/2432] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:48:10 2022] DELETE /identity/v3/users/0cf2e1c1ba3942e9a153fdf95f88ad65 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:10.864500 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:10.866028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:10.879416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c246bd-ddbe-478b-a658-5865b58d3956 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:10.891323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:10.943923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:10.948023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:10.948023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:10.948023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] PATH_INFO: `/v3/projects/849ed21b8b264b13bc7c59e32e4f192a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:10.948023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849ed21b8b264b13bc7c59e32e4f192a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:10.948390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.062303 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849ed21b8b264b13bc7c59e32e4f192a', 'request_id': 'req-8137891b-2230-44bf-9b2e-009dc82bb5e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:11.068739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849ed21b8b264b13bc7c59e32e4f192a', 'request_id': 'req-8137891b-2230-44bf-9b2e-009dc82bb5e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:11.131715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849ed21b8b264b13bc7c59e32e4f192a', 'request_id': 'req-8137891b-2230-44bf-9b2e-009dc82bb5e9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:11.144175 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] The token cache is being invalidate because project 849ed21b8b264b13bc7c59e32e4f192a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:48:11.144474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:11.145301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-8137891b-2230-44bf-9b2e-009dc82bb5e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:11.146925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1226/2433] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:48:10 2022] DELETE /identity/v3/projects/849ed21b8b264b13bc7c59e32e4f192a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:11.152855 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.153385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.153587 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.175887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:11.177468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:11.238899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1208/2434] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:11.248099 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.248384 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.248665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.269494 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:11.270724 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:11.280074 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1227/2435] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:11.283971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.294134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ebb8e1-852d-4bb9-915a-bd13167c251f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.298788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.299390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.300301 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.300582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.301267 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:48:11.301573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.303171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.317797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1209/2436] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:48:11.329948 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.341239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f05bc-6d39-458f-bb02-dbc5bfcb669e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.345999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.346611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.346904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.347190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.347801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.349759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.445459 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1228/2437] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:48:11 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:11.449240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.458370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ba715-fd08-44c8-85c7-f98430f20912 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.529562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.530181 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.530465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.530746 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.531398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.533340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.602882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:11.608046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1210/2438] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:48:11 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:48:11.612342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.623095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb381b1-c943-4392-850a-6ca66c905beb admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.627912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.628517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.628799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.629081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.629760 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.631370 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.641595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1229/2439] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:11.645754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.657471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4f2c0-6126-4e1b-9d8f-f0b4f4750a6a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.662156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.662958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.663542 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.664280 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.665539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.667168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309118ee-b755-4c9e-b853-99cef2ea6b81 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.677934 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1211/2440] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:11.682400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.692652 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4be77a-df86-46d7-bf50-89cfcaf1bedc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:11.697452 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:11.698101 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.698385 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.698662 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] PATH_INFO: `/v3/projects/12be17e91862487dbaac0d52e9b1ee2b/users/92eaf94524da4cb79c4abebfd437e60f/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.714180 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12be17e91862487dbaac0d52e9b1ee2b, user_id=92eaf94524da4cb79c4abebfd437e60f, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:11.716852 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:11.764621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1230/2441] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:11 2022] PUT /identity/v3/projects/12be17e91862487dbaac0d52e9b1ee2b/users/92eaf94524da4cb79c4abebfd437e60f/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:11.833774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:11.834078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:11.834359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:11.863016 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] MFA Rules not processed for user `92eaf94524da4cb79c4abebfd437e60f`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:11.864246 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:11.930452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1212/2442] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:11.941529 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:11.943319 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:11.988635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:12.000019 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b39aa-0e7e-44dd-9af5-a2247ff003c4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:12.003913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:12.004515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:12.004801 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:12.005076 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:12.013980 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:12.015514 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:12.025257 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1231/2443] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:21.528709 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:21.530396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:21.612146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0069c5e-e775-4bf9-895b-a143d347cec0 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:21.617863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:21.618479 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:21.618760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:21.619650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:21.621582 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:21.634344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:21.635875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb058be5-13fb-4d96-9179-1317142a8d1d service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:21.646670 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1213/2444] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:22.096428 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:23.647379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:23.710411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72068e-3910-437d-8b9c-b8fdcd220791 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:23.714967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:23.715583 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:23.715861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:23.716129 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] PATH_INFO: `/v3/users/92eaf94524da4cb79c4abebfd437e60f` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:23.717255 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92eaf94524da4cb79c4abebfd437e60f)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:23.719223 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:23.893003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92eaf94524da4cb79c4abebfd437e60f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:23.900073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92eaf94524da4cb79c4abebfd437e60f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:23.912160 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92eaf94524da4cb79c4abebfd437e60f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:23.912879 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92eaf94524da4cb79c4abebfd437e60f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.005376 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92eaf94524da4cb79c4abebfd437e60f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.011445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1232/2445] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:48:23 2022] DELETE /identity/v3/users/92eaf94524da4cb79c4abebfd437e60f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:24.016035 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.016512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.016611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.035623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:24.036823 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:24.095880 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1214/2446] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:24.105896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:24.107300 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:24.163839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb8bcb-0b03-4786-9ec6-6e54201afc57 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:24.168245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:24.168845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.169164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.169464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.178404 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:24.179854 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb33a2a3-1ce3-46ea-b6ff-1e7167ea5ed9 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:24.189318 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1233/2447] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:24.603550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:24.605833 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:24.618824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:24.625757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30208-fbc0-43bc-8736-3d07295269b1 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:24.631720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:24.632363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.632618 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.632960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] PATH_INFO: `/v3/projects/12be17e91862487dbaac0d52e9b1ee2b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.634795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12be17e91862487dbaac0d52e9b1ee2b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:24.636959 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:24.748084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12be17e91862487dbaac0d52e9b1ee2b', 'request_id': 'req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.753785 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12be17e91862487dbaac0d52e9b1ee2b', 'request_id': 'req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.760725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12be17e91862487dbaac0d52e9b1ee2b', 'request_id': 'req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.810395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] The token cache is being invalidate because project 12be17e91862487dbaac0d52e9b1ee2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:48:24.810716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.811338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-0b1aa4a5-d794-40e0-bc45-684f3b3f6002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:48:24.812828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1215/2448] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:48:24 2022] DELETE /identity/v3/projects/12be17e91862487dbaac0d52e9b1ee2b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:24.818003 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.818487 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.818618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.839337 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:24.840527 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:24.856753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:24.898497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1234/2449] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:24.906699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.907264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.907546 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.928089 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:24.929359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:24.937941 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1216/2450] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:24.941949 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:24.952046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9e05b-ed03-45b8-a9b7-fc8e8cc7a6da None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:24.956599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:24.957219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.957497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.957769 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.958403 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:48:24.958700 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:24.960290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:24.971629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1235/2451] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:48:24.975616 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:24.984870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff8ee37-39a9-4622-9ead-89253e2473fe None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:24.989471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:24.990055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:24.990333 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:24.990601 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:24.991212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:24.993078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.097994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1217/2452] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:48:24 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:25.102186 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:25.112198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31806b03-daf7-430f-9d29-783522b0c32b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:25.167682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:25.168277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.168554 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.168844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.169486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:25.171388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.256546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1236/2453] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:48:25 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:25.261187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:25.271743 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722a95c-0810-4a90-aebf-219f8a0f255a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:25.277051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:25.277826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.278105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.278379 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.279049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:25.280643 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.291119 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1218/2454] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:25.294917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:25.304928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ddb0-05d1-48a1-a5d7-d42cab8d304c admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:25.310067 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:25.310663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.310945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.311219 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.311856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:25.313541 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f878ba7-2a76-44cd-a27d-12ab3ec7e472 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.324861 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1237/2455] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:25.329073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:25.339770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe99f0-a725-464a-ac16-34efa0d869a0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:25.344386 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:25.345033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.345342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.345617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] PATH_INFO: `/v3/projects/4e8d113135c24fc68e2dcf3fb5f29fba/users/3d5b84a9445e41718be9fbfeb57a3803/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.360306 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8d113135c24fc68e2dcf3fb5f29fba, user_id=3d5b84a9445e41718be9fbfeb57a3803, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:25.362992 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.439338 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1219/2456] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:25 2022] PUT /identity/v3/projects/4e8d113135c24fc68e2dcf3fb5f29fba/users/3d5b84a9445e41718be9fbfeb57a3803/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:25.444621 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bda0f-a7c2-437c-960d-8f01b1d8631d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.444928 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bda0f-a7c2-437c-960d-8f01b1d8631d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.445274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bda0f-a7c2-437c-960d-8f01b1d8631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.465707 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-579bda0f-a7c2-437c-960d-8f01b1d8631d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:25.466904 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-579bda0f-a7c2-437c-960d-8f01b1d8631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:25.524301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1238/2457] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:25.534434 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:25.536277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:25.593839 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fda43-5a82-4261-bf2c-1be5860a25c4 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:25.597539 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:25.598144 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:25.598425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:25.598699 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:25.607645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:25.609071 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:25.618824 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1220/2458] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:30.596379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:30.596880 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:30.596966 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:30.630565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] MFA Rules not processed for user `3d5b84a9445e41718be9fbfeb57a3803`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:30.632073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:30.651216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:30.703126 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1239/2459] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:30.707604 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:30.718266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f0891-ed12-4ecb-bc44-c86f5b75b72f service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:30.722808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:30.723423 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:30.723715 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:30.723974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:30.724611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:30.726564 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:30.806340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1221/2460] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:48:30 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:30.810469 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:30.825335 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2484f-a1a3-494e-b746-a2ce779a9f79 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:30.892100 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:30.892808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:30.893191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:30.893532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:30.894227 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:30.896491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:30.989715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1240/2461] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:48:30 2022] POST /identity/v3/users => generated 298 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:48:30.994147 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:31.001724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:31.006287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c347fc-eb29-4456-87a0-cfd47ee982dc admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:31.011970 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:31.012705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:31.013051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:31.013438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:31.014169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:31.015909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:31.027638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1222/2462] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:31.032261 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:31.043144 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2887-2ea4-462b-adfb-02b1273ae2f2 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:31.048284 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:31.049411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:31.049740 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:31.050136 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] PATH_INFO: `/v3/projects/0269af00179143b8b66265e24e2ded24/users/0113b12a14354d6f9b954bb57ca6dbc9/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:31.068942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0269af00179143b8b66265e24e2ded24, user_id=0113b12a14354d6f9b954bb57ca6dbc9, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:31.072738 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:31.140200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1241/2463] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:31 2022] PUT /identity/v3/projects/0269af00179143b8b66265e24e2ded24/users/0113b12a14354d6f9b954bb57ca6dbc9/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:48:31.144524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:31.155068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a321b-0474-454a-8365-93a19d8e905a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:31.217672 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:31.218305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:31.218590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:31.218866 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:31.219521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:31.221188 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720a4a89-725d-4e59-b4fa-4a5e11ea6a12 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:31.231789 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1223/2464] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:48:31.236043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:31.247445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003a93d-14c9-467d-a4c6-1b292416cf91 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:31.252286 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:31.252891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:31.253209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:31.253485 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] PATH_INFO: `/v3/projects/0269af00179143b8b66265e24e2ded24/users/0113b12a14354d6f9b954bb57ca6dbc9/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:31.255511 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0269af00179143b8b66265e24e2ded24, user_id=0113b12a14354d6f9b954bb57ca6dbc9, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:31.258238 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:31.270236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1242/2465] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:48:31 2022] PUT /identity/v3/projects/0269af00179143b8b66265e24e2ded24/users/0113b12a14354d6f9b954bb57ca6dbc9/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:48:36.518037 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f893-58fe-48b7-8fe7-ba4fcadda1f9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:36.518910 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f893-58fe-48b7-8fe7-ba4fcadda1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:36.519194 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f893-58fe-48b7-8fe7-ba4fcadda1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:36.550776 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-91b3f893-58fe-48b7-8fe7-ba4fcadda1f9 None None] MFA Rules not processed for user `0113b12a14354d6f9b954bb57ca6dbc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:36.552001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-91b3f893-58fe-48b7-8fe7-ba4fcadda1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:36.636846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1224/2466] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:36 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:36.650696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:36.652520 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:36.721681 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0817b-2577-4816-87af-09c1058b06c4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:36.728619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '09aecc43a8ab487c8ecfe0673ab12534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:36.728619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:36.728619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:36.728619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:36.759843 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:36.797839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:36.799298 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:36.812123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1243/2467] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:48:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:48:37.112782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5fdb-bfa1-4a03-b785-2ef714b0b3a7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:37.112782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5fdb-bfa1-4a03-b785-2ef714b0b3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:37.112782 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac5fdb-bfa1-4a03-b785-2ef714b0b3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:37.138401 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-15ac5fdb-bfa1-4a03-b785-2ef714b0b3a7 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:37.139640 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-15ac5fdb-bfa1-4a03-b785-2ef714b0b3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:37.200617 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1225/2468] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:48:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:48:37.349830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:37.351279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:37.424070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59522344-6735-4e49-a0dd-ffd4b1a0053d service glance] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:37.429070 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:37.430128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:37.430519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:37.430679 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:37.439439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:37.441063 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b7f6b3-5943-47a5-9331-c7eb212c182a service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:37.450214 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1244/2469] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:48:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:48:47.193669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:47.446282 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=48 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:47.825186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:47.825475 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:47.825759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:47.845370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] MFA Rules not processed for user `3d5b84a9445e41718be9fbfeb57a3803`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:47.846575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:47.853733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1226/2470] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:48:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:51.256358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:51.256874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:51.256985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:51.276962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:48:51.279617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:48:51.286251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1245/2471] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:48:51.297615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:48:51.311007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6662949-0a60-4f00-b5a1-b67a0fb018f6 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:48:51.321755 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:48:51.322464 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:48:51.322810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:48:51.323609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:48:51.332327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:48:51.334073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:48:51.342725 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1227/2472] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:48:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:49:01.271362 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:01.339160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=9 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:15.877753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:15.954778 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91636cb9-5a7a-492e-851a-05bfa22b5a7c None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:15.958640 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:15.959256 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:15.959540 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:15.959815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:15.994425 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:15.995877 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:16.008213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1246/2473] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:49:18.790177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:18.792953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:49:18.938146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a5692-bbb1-4c62-80dc-629018331146 service swift] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:18.943606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:18.944355 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:18.944704 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:18.945047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:18.947011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:49:18.959912 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:18.970953 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:18.972669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1228/2474] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:49:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:49:26.003765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=44 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:28.967827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=59 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:40.718930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:40.724277 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:49:40.818084 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3450c46-8bde-4c8c-bde9-f307e321ff79 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:40.823323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:40.823955 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:40.824236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:40.824515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] PATH_INFO: `/v3/users/ebf4be17863247648c2a1f06048cc5c1` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:40.825682 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebf4be17863247648c2a1f06048cc5c1)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:40.827608 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:41.045959 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebf4be17863247648c2a1f06048cc5c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.053080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebf4be17863247648c2a1f06048cc5c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.065556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebf4be17863247648c2a1f06048cc5c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.066231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebf4be17863247648c2a1f06048cc5c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.136609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebf4be17863247648c2a1f06048cc5c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.142723 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1247/2475] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:49:40 2022] DELETE /identity/v3/users/ebf4be17863247648c2a1f06048cc5c1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:49:41.390728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:41.402485 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5632d45-7b03-4903-890a-503c61e02906 service placement] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:41.463532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:41.464166 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:41.464452 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:41.464730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] PATH_INFO: `/v3/projects/ca4ef8c793ac4f54b74f967ffd6078b1` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:41.465898 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4ef8c793ac4f54b74f967ffd6078b1)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:41.467812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:41.571150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4ef8c793ac4f54b74f967ffd6078b1', 'request_id': 'req-a217b96e-cdb3-4d1d-8ce5-284321bb392e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.576793 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4ef8c793ac4f54b74f967ffd6078b1', 'request_id': 'req-a217b96e-cdb3-4d1d-8ce5-284321bb392e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.585404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4ef8c793ac4f54b74f967ffd6078b1', 'request_id': 'req-a217b96e-cdb3-4d1d-8ce5-284321bb392e'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.667292 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] The token cache is being invalidate because project ca4ef8c793ac4f54b74f967ffd6078b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:49:41.667563 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.668238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.669740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1229/2476] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:49:41 2022] DELETE /identity/v3/projects/ca4ef8c793ac4f54b74f967ffd6078b1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:49:41.673735 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:41.675142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:49:41.688977 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388e4e85-229e-4a9a-89a8-f68d08ead2b6 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:41.736348 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:41.745752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:41.747484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:41.747484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:41.747484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] PATH_INFO: `/v3/users/63aa87903bcb411a8a1028742ab55566` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:41.748057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63aa87903bcb411a8a1028742ab55566)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:41.750028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:41.927380 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63aa87903bcb411a8a1028742ab55566'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.935190 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63aa87903bcb411a8a1028742ab55566'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.948544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63aa87903bcb411a8a1028742ab55566'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:41.949279 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63aa87903bcb411a8a1028742ab55566'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.010923 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-30f9922b-3fce-4a84-b268-4cb5563c2577 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63aa87903bcb411a8a1028742ab55566'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.017103 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1248/2477] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:49:41 2022] DELETE /identity/v3/users/63aa87903bcb411a8a1028742ab55566 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:49:42.258398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:49:42.259689 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:49:42.272882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b96e-cdb3-4d1d-8ce5-284321bb392e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:49:42.333329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:49:42.333963 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:49:42.334241 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:49:42.334513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] PATH_INFO: `/v3/projects/16931758f3a64040b80bfe4e899d7a31` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:49:42.335655 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16931758f3a64040b80bfe4e899d7a31)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:49:42.337628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:49:42.422335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:42.435145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16931758f3a64040b80bfe4e899d7a31', 'request_id': 'req-a2a19fb7-081e-4323-a8d0-7c67ad098181'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.440935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16931758f3a64040b80bfe4e899d7a31', 'request_id': 'req-a2a19fb7-081e-4323-a8d0-7c67ad098181'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.447482 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16931758f3a64040b80bfe4e899d7a31', 'request_id': 'req-a2a19fb7-081e-4323-a8d0-7c67ad098181'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.496268 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] The token cache is being invalidate because project 16931758f3a64040b80bfe4e899d7a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:49:42.496799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.497978 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:49:42.499600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1230/2478] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:49:42 2022] DELETE /identity/v3/projects/16931758f3a64040b80bfe4e899d7a31 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:49:52.013334 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:52.565104 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:43.211665 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b829-2b85-4255-9b59-45fe26d00777 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:43.212128 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b829-2b85-4255-9b59-45fe26d00777 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:43.212237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068b829-2b85-4255-9b59-45fe26d00777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:43.242556 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1068b829-2b85-4255-9b59-45fe26d00777 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:50:43.243753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1068b829-2b85-4255-9b59-45fe26d00777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:43.303930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1249/2479] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:50:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:50:43.345291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:43.346692 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:43.414683 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a19fb7-081e-4323-a8d0-7c67ad098181 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:43.420298 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:43.420899 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:43.421209 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:43.421489 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:43.429799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:43.431365 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:43.439335 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1231/2480] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:50:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:50:47.629607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:47.630794 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:47.631515 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:47.655168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] MFA Rules not processed for user `b0c20a3a784141b1b4ea4a314f26bc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:50:47.659815 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:47.723872 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1250/2481] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:50:48.065834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:48.067248 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:48.158937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45fc0f-4fe0-498d-86bb-507a292b16a0 service swift] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:48.162611 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:48.163218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:48.163494 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:48.163766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:48.165548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:48.175728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:48.179984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:48.185858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1232/2482] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:50:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:50:51.797206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:51.797206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:51.860378 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b0da0f-37c8-44b4-bc00-157d9c725b48 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:51.865060 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:51.865725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:51.866009 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:51.866316 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] PATH_INFO: `/v3/users/3d5b84a9445e41718be9fbfeb57a3803` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:51.867473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5b84a9445e41718be9fbfeb57a3803)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:51.869434 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:52.019345 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:52.028453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5b84a9445e41718be9fbfeb57a3803'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.035618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5b84a9445e41718be9fbfeb57a3803'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.049153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5b84a9445e41718be9fbfeb57a3803'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.050041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5b84a9445e41718be9fbfeb57a3803'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.126752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5b84a9445e41718be9fbfeb57a3803'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.133213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1251/2483] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:50:51 2022] DELETE /identity/v3/users/3d5b84a9445e41718be9fbfeb57a3803 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:50:52.373930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:52.385969 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5cebe4-9cf3-4648-9f3f-1eb6c1345021 service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:52.443770 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:52.444313 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:52.444596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:52.444875 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] PATH_INFO: `/v3/projects/4e8d113135c24fc68e2dcf3fb5f29fba` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:52.446067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8d113135c24fc68e2dcf3fb5f29fba)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:52.447981 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:52.463882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=100 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:52.559512 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8d113135c24fc68e2dcf3fb5f29fba', 'request_id': 'req-8b1578ee-f092-4b47-9ebd-90231daca3bb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.565036 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8d113135c24fc68e2dcf3fb5f29fba', 'request_id': 'req-8b1578ee-f092-4b47-9ebd-90231daca3bb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.571215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8d113135c24fc68e2dcf3fb5f29fba', 'request_id': 'req-8b1578ee-f092-4b47-9ebd-90231daca3bb'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.634059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] The token cache is being invalidate because project 4e8d113135c24fc68e2dcf3fb5f29fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:50:52.634352 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.634974 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.636967 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1233/2484] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:50:52 2022] DELETE /identity/v3/projects/4e8d113135c24fc68e2dcf3fb5f29fba => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:50:52.641092 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:52.642538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:52.656123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892116ed-1a80-4ad2-9910-f968406b8b58 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:52.712216 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:52.712807 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:52.713094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:52.713439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] PATH_INFO: `/v3/users/0113b12a14354d6f9b954bb57ca6dbc9` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:52.715220 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0113b12a14354d6f9b954bb57ca6dbc9)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:52.717226 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:52.874806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0113b12a14354d6f9b954bb57ca6dbc9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.883512 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0113b12a14354d6f9b954bb57ca6dbc9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.897055 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0113b12a14354d6f9b954bb57ca6dbc9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.897888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0113b12a14354d6f9b954bb57ca6dbc9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.978183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0113b12a14354d6f9b954bb57ca6dbc9'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:52.985178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1252/2485] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:50:52 2022] DELETE /identity/v3/users/0113b12a14354d6f9b954bb57ca6dbc9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:50:53.262917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:50:53.266944 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:50:53.283059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1578ee-f092-4b47-9ebd-90231daca3bb admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:50:53.346799 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:50:53.347474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:50:53.347749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:50:53.348105 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] PATH_INFO: `/v3/projects/0269af00179143b8b66265e24e2ded24` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:50:53.349278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0269af00179143b8b66265e24e2ded24)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:50:53.351212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:50:53.492926 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0269af00179143b8b66265e24e2ded24', 'request_id': 'req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:53.499131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0269af00179143b8b66265e24e2ded24', 'request_id': 'req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:53.505425 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0269af00179143b8b66265e24e2ded24', 'request_id': 'req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:53.646132 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] The token cache is being invalidate because project 0269af00179143b8b66265e24e2ded24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:50:53.646430 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:53.647066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:50:53.648575 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1234/2486] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:50:53 2022] DELETE /identity/v3/projects/0269af00179143b8b66265e24e2ded24 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:51:02.980912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=68,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:03.642783 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=69,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:04.383431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:51:04.384960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:51:04.442035 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11963a45-1451-4def-90a7-1929fab866ba admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:51:04.490166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:51:04.490777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:51:04.491096 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:51:04.491435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:51:04.493245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:51:04.573774 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:51:04.575716 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:51:04.596613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1253/2487] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:51:05.776862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:51:05.778392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:51:05.790392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d962-a5dc-4ed9-be34-3b4756d3f446 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:51:05.794019 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:51:05.794607 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:51:05.794885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:51:05.795156 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:51:05.797066 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:51:05.810407 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:51:05.811815 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:51:05.822581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1235/2488] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:51:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:51:14.594026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=83 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:15.817828 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=6 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:02.599412 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:02.600916 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:02.673039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f65da-f2b6-427a-a840-1c894cd65218 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:02.678645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:02.680379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:02.680379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:02.680379 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:02.681553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:02.693598 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:02.695165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:02.705614 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1254/2489] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:02.717424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:02.717424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:02.783339 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b058457-23e7-410f-b1e2-908f378c5d7e service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:02.787954 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:02.788583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:02.788864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:02.789161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] PATH_INFO: `/v3/users/b0c20a3a784141b1b4ea4a314f26bc7b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:02.790282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c20a3a784141b1b4ea4a314f26bc7b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:02.792200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:02.965723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c20a3a784141b1b4ea4a314f26bc7b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:02.973432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c20a3a784141b1b4ea4a314f26bc7b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:02.974145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c20a3a784141b1b4ea4a314f26bc7b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.061063 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c20a3a784141b1b4ea4a314f26bc7b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.074212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-142a3fec-8298-4d21-ac1b-138127a8e7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c20a3a784141b1b4ea4a314f26bc7b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.080161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1236/2490] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:02 2022] DELETE /identity/v3/users/b0c20a3a784141b1b4ea4a314f26bc7b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:03.319899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:03.331056 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539b1d73-cb8f-4f0d-80c7-65c773cf3aee service placement] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:03.387406 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:03.388030 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:03.388308 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:03.388580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] PATH_INFO: `/v3/projects/d82855b9e6004a888923fe62fbbb0377` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:03.389718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82855b9e6004a888923fe62fbbb0377)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:03.391617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:03.515153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82855b9e6004a888923fe62fbbb0377', 'request_id': 'req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.521623 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82855b9e6004a888923fe62fbbb0377', 'request_id': 'req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.592301 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82855b9e6004a888923fe62fbbb0377', 'request_id': 'req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.603323 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] The token cache is being invalidate because project d82855b9e6004a888923fe62fbbb0377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:03.603874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.604239 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-d3ce3da9-ae95-42a0-b7ea-8ad06def3b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:03.605770 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1255/2491] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:03 2022] DELETE /identity/v3/projects/d82855b9e6004a888923fe62fbbb0377 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:52:03.610638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:03.610928 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:03.611202 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:03.668238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:03.669788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:03.713573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:03.728814 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1237/2492] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:52:03.736346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:03.736633 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:03.741346 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:03.759199 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:03.760399 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:03.768302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1256/2493] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:03.772516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:03.782059 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe23749-170e-4b4e-a7a4-d4512eae6552 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:03.787309 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:03.787901 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:03.788178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:03.788441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:03.789083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:52:03.789417 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:03.790996 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:03.803205 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1238/2494] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:52:03.807366 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:03.816612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0407d4-7820-473b-b856-d4e1ad428c53 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:03.821357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:03.821944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:03.822222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:03.827431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:03.827431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:03.827431 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:03.836361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:03.931433 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1257/2495] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:03 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:52:03.935641 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:03.945745 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf87241-df5b-4933-a95f-7e50ef802dd0 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.007289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.007889 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.008167 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.008438 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.009072 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.011047 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.123797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1239/2496] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:03 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:04.127753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.138122 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b585cf1-9e1e-4664-89ed-a696c7d2baa8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.142737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.143322 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.143597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.143865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.144493 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.146664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.156661 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1258/2497] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:04.160925 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.171939 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7e393-df29-4a01-9342-289765b92546 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.176644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.177279 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.177572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.177850 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.178493 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.180138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b4b64-7a81-4a25-9026-b3290831e6ec admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.189883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1240/2498] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:04.193912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.204043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d495e1-e85c-4e9e-bfe3-8bf0c919ca98 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.209176 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.209816 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.210093 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.210365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] PATH_INFO: `/v3/projects/57df279e2a9742d58240e48739eb4e2d/users/f9bf6834f81a4707b86d91d6b1d3a960/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.225546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57df279e2a9742d58240e48739eb4e2d, user_id=f9bf6834f81a4707b86d91d6b1d3a960, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.228294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.300642 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1259/2499] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:04 2022] PUT /identity/v3/projects/57df279e2a9742d58240e48739eb4e2d/users/f9bf6834f81a4707b86d91d6b1d3a960/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:52:04.312122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.312409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.312690 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.341590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] MFA Rules not processed for user `f9bf6834f81a4707b86d91d6b1d3a960`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:04.342820 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:04.405549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1241/2500] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:04.410051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.470765 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e303aa-1c7d-4d5e-97bb-5a5213823375 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.476017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.476618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.476901 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.477202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.477865 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.479798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.541435 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1260/2501] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:04 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:04.545772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.557005 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d99bb7-aecf-4d53-8444-31a8788f0eca None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.598505 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:04.614174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.614800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.615083 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.615390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.616073 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.618100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.706786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1242/2502] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:04 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:04.711364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.723026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e9d279-b11e-4044-8a3f-b4e7ef5a2104 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.727696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.728291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.728572 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.728845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.729517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.731115 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.741678 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1261/2503] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:04.745733 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.756247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad90100-d37d-4f55-8164-edfb87330b2d admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.760919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.761600 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.761883 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.762160 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] PATH_INFO: `/v3/projects/140a82c869ce4a8fb6facf04fe20cccc/users/1444577c8a1648f9acfaecb6a3dd1961/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.777266 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a82c869ce4a8fb6facf04fe20cccc, user_id=1444577c8a1648f9acfaecb6a3dd1961, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.779922 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.843039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1243/2504] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:04 2022] PUT /identity/v3/projects/140a82c869ce4a8fb6facf04fe20cccc/users/1444577c8a1648f9acfaecb6a3dd1961/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:04.846985 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.857039 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1122ce-7cf2-4e0f-8fc2-ef8f5bf7ef37 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.913016 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.913653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.913934 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.914209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.914845 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.916467 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f57ae1-abf3-4262-a0f9-8e1a5cfd51fd admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.926236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1262/2505] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:04.931048 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:04.941484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f5ee9-ac6f-4949-99a1-e8c6d23ddf2b admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:04.946650 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:04.947300 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.947585 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.947864 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] PATH_INFO: `/v3/projects/140a82c869ce4a8fb6facf04fe20cccc/users/1444577c8a1648f9acfaecb6a3dd1961/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:04.949803 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=140a82c869ce4a8fb6facf04fe20cccc, user_id=1444577c8a1648f9acfaecb6a3dd1961, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:04.952453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:04.962584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1244/2506] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:04 2022] PUT /identity/v3/projects/140a82c869ce4a8fb6facf04fe20cccc/users/1444577c8a1648f9acfaecb6a3dd1961/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:04.972502 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:04.972790 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:04.973097 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:05.001688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] MFA Rules not processed for user `1444577c8a1648f9acfaecb6a3dd1961`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:05.002914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:05.008427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:05.071229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1263/2507] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:05.082091 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:05.083856 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:05.163055 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ee8c-0809-4ec9-b7ea-970d266ea41e admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:05.166638 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:05.167244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:05.167524 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:05.167797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:05.177039 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:05.179032 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc518f-657e-4d18-97df-727d807ae138 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:05.188368 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1245/2508] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:05.319611 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:05.381627 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d35ef-14dc-4bb6-8c45-0927f02d8266 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:05.386196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:05.386826 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:05.387108 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:05.387383 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] PATH_INFO: `/v3/users/f9bf6834f81a4707b86d91d6b1d3a960` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:05.388503 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9bf6834f81a4707b86d91d6b1d3a960)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:05.390458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:05.587673 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9bf6834f81a4707b86d91d6b1d3a960'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:05.594715 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9bf6834f81a4707b86d91d6b1d3a960'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:05.607213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9bf6834f81a4707b86d91d6b1d3a960'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:05.607884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9bf6834f81a4707b86d91d6b1d3a960'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:05.711817 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9bf6834f81a4707b86d91d6b1d3a960'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:05.717997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1264/2509] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:05 2022] DELETE /identity/v3/users/f9bf6834f81a4707b86d91d6b1d3a960 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:05.722478 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:05.722769 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:05.723045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:05.742377 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:05.743595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:05.800972 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1246/2510] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:05.811061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:05.812473 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:05.839222 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:05.869287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ace5-7262-4e9e-a42b-b89da5c8c6bc admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:05.873446 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:05.874047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:05.874327 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:05.874601 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:05.884089 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:05.885566 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:05.894831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1265/2511] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:06.308436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:06.310017 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:06.323373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7afd1-0c80-402c-8870-4fa2b481847b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:06.332621 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:06.333534 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:06.333936 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:06.334360 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] PATH_INFO: `/v3/projects/57df279e2a9742d58240e48739eb4e2d` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:06.335691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=57df279e2a9742d58240e48739eb4e2d)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:06.337792 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:06.354590 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:06.461477 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57df279e2a9742d58240e48739eb4e2d', 'request_id': 'req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.467025 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57df279e2a9742d58240e48739eb4e2d', 'request_id': 'req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.473291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57df279e2a9742d58240e48739eb4e2d', 'request_id': 'req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.539169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] The token cache is being invalidate because project 57df279e2a9742d58240e48739eb4e2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:06.539462 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.540085 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.541596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1247/2512] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:06 2022] DELETE /identity/v3/projects/57df279e2a9742d58240e48739eb4e2d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:06.545884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:06.555587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb2431-9f1a-495c-9f34-6a380b368545 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:06.611387 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:06.611935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:06.612213 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:06.612484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] PATH_INFO: `/v3/users/1444577c8a1648f9acfaecb6a3dd1961` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:06.613620 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1444577c8a1648f9acfaecb6a3dd1961)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:06.615630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:06.798698 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1444577c8a1648f9acfaecb6a3dd1961'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.805856 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1444577c8a1648f9acfaecb6a3dd1961'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.817753 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1444577c8a1648f9acfaecb6a3dd1961'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.818445 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1444577c8a1648f9acfaecb6a3dd1961'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.888956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a2d3d8c7-6372-4a1d-9e68-c4e45e4b41c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1444577c8a1648f9acfaecb6a3dd1961'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:06.895109 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1266/2513] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:06 2022] DELETE /identity/v3/users/1444577c8a1648f9acfaecb6a3dd1961 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:07.290471 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:07.292002 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:07.306171 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3dac-8ae8-4df9-bc54-4e2bebadaf7c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:07.363943 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:07.364581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.364863 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.365169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] PATH_INFO: `/v3/projects/140a82c869ce4a8fb6facf04fe20cccc` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.366795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] RBAC: Authorizing `identity:delete_project(project_id=140a82c869ce4a8fb6facf04fe20cccc)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:07.368724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:07.467406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '140a82c869ce4a8fb6facf04fe20cccc', 'request_id': 'req-913b1d62-0937-40b4-81f6-53f14ac4b30d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:07.473113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '140a82c869ce4a8fb6facf04fe20cccc', 'request_id': 'req-913b1d62-0937-40b4-81f6-53f14ac4b30d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:07.480127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '140a82c869ce4a8fb6facf04fe20cccc', 'request_id': 'req-913b1d62-0937-40b4-81f6-53f14ac4b30d'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:07.550885 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] The token cache is being invalidate because project 140a82c869ce4a8fb6facf04fe20cccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:07.551178 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:07.551808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-913b1d62-0937-40b4-81f6-53f14ac4b30d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:07.553322 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1248/2514] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:07 2022] DELETE /identity/v3/projects/140a82c869ce4a8fb6facf04fe20cccc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:07.558918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.559202 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.559471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.578864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:07.580062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:07.620196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:07.638475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1267/2515] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:07.646283 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.646642 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.646986 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.666955 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:07.668162 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:07.676390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1249/2516] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:07.681112 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:07.690739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5351f6-f1e1-46d7-830f-d62941d46815 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:07.695336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:07.695922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.696198 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.696466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.697146 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:52:07.697463 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:07.699044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:07.710922 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1268/2517] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:52:07.714932 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:07.724234 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34576879-b9bf-497e-9d40-5e9f2e9ce679 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:07.729410 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:07.730001 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.730282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.730565 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.731190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:07.733067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:07.844988 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1250/2518] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:07 2022] POST /identity/v3/projects => generated 357 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:07.848935 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:07.859574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e8df3-8cf3-4863-bc7a-b47de73ed6ea admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:07.914891 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:07.915491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:07.915773 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:07.916072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:07.916710 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:07.918648 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:07.997798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1269/2519] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:07 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:08.001797 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.008583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:08.012291 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afb6f4-b4ff-4c99-9955-aabce69a9c52 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.016902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.017543 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.017825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.018122 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.018765 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.020351 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.030677 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1251/2520] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:08.034538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.045394 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edae0e-6c9b-447f-a677-0de8dad13863 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.050023 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.050612 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.050894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.051171 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.051805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.053427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d7a26-eee1-49af-95a0-5c770c80d214 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.064094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1270/2521] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:08.068211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.078302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d3e645-99cc-48dc-93cd-8ea96eb98106 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.082892 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.083536 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.083811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.084086 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] PATH_INFO: `/v3/projects/8f2fee7bcfe5405983bf79ff6d6f7475/users/65cf12931f4a492f8ada4e63d58a97e3/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.098775 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f2fee7bcfe5405983bf79ff6d6f7475, user_id=65cf12931f4a492f8ada4e63d58a97e3, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.102183 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.174432 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1252/2522] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:08 2022] PUT /identity/v3/projects/8f2fee7bcfe5405983bf79ff6d6f7475/users/65cf12931f4a492f8ada4e63d58a97e3/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:08.185699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.185987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.186265 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.214229 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] MFA Rules not processed for user `65cf12931f4a492f8ada4e63d58a97e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:08.215455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:08.278833 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1271/2523] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:08.283226 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.345595 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b5019-3eb6-4949-a75c-b71e22905ef7 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.350278 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.350909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.351190 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.351468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.352109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.354041 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.438825 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1253/2524] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:08 2022] POST /identity/v3/projects => generated 357 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:08.442848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.454054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef609e24-9213-4f13-9fc1-632800b96baa None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.492013 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:08.510179 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.510784 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.511064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.511338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.511956 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.513896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.637517 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1272/2525] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:08 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:08.641500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.651915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac01e98-017c-4b58-8ac4-ad0338d51c0f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.656609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.657238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.657522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.657800 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.658447 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.660044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.670873 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1254/2526] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:08.674804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.685607 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a58bc-bb64-4270-b5e5-d4713241adb1 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.690347 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.690994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.691276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.691552 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] PATH_INFO: `/v3/projects/c0ce5273a2c948339c193a284b7d3d81/users/b7c9fd9cf7db4a34bd3f35ff30c2d810/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.706830 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce5273a2c948339c193a284b7d3d81, user_id=b7c9fd9cf7db4a34bd3f35ff30c2d810, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.709496 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.774805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1273/2527] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:08 2022] PUT /identity/v3/projects/c0ce5273a2c948339c193a284b7d3d81/users/b7c9fd9cf7db4a34bd3f35ff30c2d810/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:52:08.778730 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.788646 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be852696-0193-4b5f-9679-0ed53ab5db95 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.844906 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.845531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.845811 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.846082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.846714 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.848295 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102a53-7ca7-417e-813c-cabff61903aa admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.857636 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1255/2528] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:08.861925 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:08.872711 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf9d6d-faf5-4757-9ce7-5b070d02a320 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:08.877341 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:08.877986 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.878268 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.878571 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] PATH_INFO: `/v3/projects/c0ce5273a2c948339c193a284b7d3d81/users/b7c9fd9cf7db4a34bd3f35ff30c2d810/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.880499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ce5273a2c948339c193a284b7d3d81, user_id=b7c9fd9cf7db4a34bd3f35ff30c2d810, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:08.883806 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:08.893915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1274/2529] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:08 2022] PUT /identity/v3/projects/c0ce5273a2c948339c193a284b7d3d81/users/b7c9fd9cf7db4a34bd3f35ff30c2d810/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:08.903832 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:08.904120 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:08.904398 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:08.932538 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] MFA Rules not processed for user `b7c9fd9cf7db4a34bd3f35ff30c2d810`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:08.933781 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:08.962364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:09.001615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1256/2530] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:09.013105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:09.014913 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:09.072690 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b62f5-4db3-4ef2-90d4-0939142dfc83 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:09.076342 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:09.076942 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:09.077267 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:09.077546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:09.086466 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:09.087893 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:09.098295 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1275/2531] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:09.417053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:09.426882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171801f6-6148-4552-8afa-40c2c37a7532 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:09.430444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:09.431031 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:09.431323 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:09.431577 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:09.491237 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:09.492664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b535bd2-428b-49bd-a9ff-a810e1c77c36 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:09.501453 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1257/2532] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:19.093119 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=52,keystone:INSERT=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:19.499521 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=44 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:26.725548 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:26.787145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e303b3-2a0f-4850-accc-105a2ada34c4 service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:26.791945 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:26.793258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:26.793539 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:26.794094 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] PATH_INFO: `/v3/users/65cf12931f4a492f8ada4e63d58a97e3` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:26.795218 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cf12931f4a492f8ada4e63d58a97e3)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:26.797145 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:26.970836 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cf12931f4a492f8ada4e63d58a97e3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:26.977896 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cf12931f4a492f8ada4e63d58a97e3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:26.989744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cf12931f4a492f8ada4e63d58a97e3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:26.990478 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cf12931f4a492f8ada4e63d58a97e3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.059999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cf12931f4a492f8ada4e63d58a97e3'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.066208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1276/2533] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:26 2022] DELETE /identity/v3/users/65cf12931f4a492f8ada4e63d58a97e3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:27.070717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:27.071196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:27.071342 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:27.091581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:27.092924 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:27.151408 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1258/2534] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:27.161743 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:27.163231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:27.219844 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446aa2e-1236-451f-a1b4-6cd45d90e3fe admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:27.223481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:27.224078 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:27.224358 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:27.224630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:27.233580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:27.234937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:27.244196 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1277/2535] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:27.661363 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:27.664272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:27.677145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc394d-9fe9-4c1c-a73b-e370dc7d2518 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:27.681976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:27.683340 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:27.683637 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:27.683915 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] PATH_INFO: `/v3/projects/8f2fee7bcfe5405983bf79ff6d6f7475` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:27.685067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f2fee7bcfe5405983bf79ff6d6f7475)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:27.687136 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:27.792376 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f2fee7bcfe5405983bf79ff6d6f7475', 'request_id': 'req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.798138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f2fee7bcfe5405983bf79ff6d6f7475', 'request_id': 'req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.804327 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f2fee7bcfe5405983bf79ff6d6f7475', 'request_id': 'req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.888444 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] The token cache is being invalidate because project 8f2fee7bcfe5405983bf79ff6d6f7475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:27.888734 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.889388 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:27.890893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1259/2536] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:27 2022] DELETE /identity/v3/projects/8f2fee7bcfe5405983bf79ff6d6f7475 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:27.895025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:27.905209 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142d09-ad81-4a9c-8ef4-09df8bc25f87 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:27.923292 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:27.961028 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:27.961733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:27.962015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:27.962291 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] PATH_INFO: `/v3/users/b7c9fd9cf7db4a34bd3f35ff30c2d810` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:27.963408 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c9fd9cf7db4a34bd3f35ff30c2d810)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:27.966029 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:28.119981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c9fd9cf7db4a34bd3f35ff30c2d810'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.127184 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c9fd9cf7db4a34bd3f35ff30c2d810'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.139450 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c9fd9cf7db4a34bd3f35ff30c2d810'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.140137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c9fd9cf7db4a34bd3f35ff30c2d810'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.230809 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-454752b0-db06-4161-bc39-38ab01b16053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c9fd9cf7db4a34bd3f35ff30c2d810'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.236937 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1278/2537] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:27 2022] DELETE /identity/v3/users/b7c9fd9cf7db4a34bd3f35ff30c2d810 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:28.661270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:28.662886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:28.677062 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3e5f2-757d-4b53-a1e3-a193a55ce755 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:28.734412 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:28.735045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:28.735329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:28.735605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] PATH_INFO: `/v3/projects/c0ce5273a2c948339c193a284b7d3d81` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:28.736713 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ce5273a2c948339c193a284b7d3d81)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:28.738748 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:28.838470 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:28.854612 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ce5273a2c948339c193a284b7d3d81', 'request_id': 'req-96f28fb6-ec81-4bfd-a74a-6104afb96432'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.860131 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ce5273a2c948339c193a284b7d3d81', 'request_id': 'req-96f28fb6-ec81-4bfd-a74a-6104afb96432'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.866370 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ce5273a2c948339c193a284b7d3d81', 'request_id': 'req-96f28fb6-ec81-4bfd-a74a-6104afb96432'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.944795 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] The token cache is being invalidate because project c0ce5273a2c948339c193a284b7d3d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:28.945029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.945721 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-96f28fb6-ec81-4bfd-a74a-6104afb96432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:28.947224 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1260/2538] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:28 2022] DELETE /identity/v3/projects/c0ce5273a2c948339c193a284b7d3d81 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:28.952714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:28.953206 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:28.953339 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:28.972756 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:28.974043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:29.032964 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1279/2539] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:29.041890 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.047329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.047329 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.063274 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:29.064522 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:29.072537 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1261/2540] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:29.077317 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.087106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8b576-9f14-449d-9615-030d3158751d None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.091693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.092310 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.092595 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.092869 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.093615 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:52:29.093920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.095509 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.107410 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1280/2541] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:52:29.111669 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.121556 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6369b1f-a308-4cf3-ac03-71508726cd7f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.126254 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.126846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.127179 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.127484 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.128111 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.130043 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.239598 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1262/2542] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/projects => generated 387 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:29.243744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.254262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e1073c-9f25-40be-a7c8-18351b7a603b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.279609 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:29.310140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.310736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.311018 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.311290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.311918 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.313894 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.402721 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1281/2543] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:29.406784 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.417853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c269d53-6bcf-46d6-9418-5260e229368a admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.422788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.423385 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.423664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.423937 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.424605 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.426232 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.436757 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1263/2544] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:29.440617 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.451061 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179d3f4-de97-498b-8323-be4304faf8e2 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.455645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.456231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.456506 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.456776 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.457441 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.459015 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a0441c-60ce-4c02-8d69-70e0553dbba3 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.469953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1282/2545] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:29.473902 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.484395 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fda12c-88dd-405b-a0f4-f37bc75a632f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.489067 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.489786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.490015 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.490289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] PATH_INFO: `/v3/projects/6a0281dd82bb4c91a54474054573d961/users/ae779351db274aac8bd3c50283bb3a9b/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.504442 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a0281dd82bb4c91a54474054573d961, user_id=ae779351db274aac8bd3c50283bb3a9b, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.507129 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.562860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1264/2546] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:29 2022] PUT /identity/v3/projects/6a0281dd82bb4c91a54474054573d961/users/ae779351db274aac8bd3c50283bb3a9b/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:29.573106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.573489 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.576200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.602087 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] MFA Rules not processed for user `ae779351db274aac8bd3c50283bb3a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:29.603288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:29.670285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1283/2547] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:29.674708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.737596 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4becf4-e5ac-4b6e-9e41-44f4f96e8f2c admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.742318 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.742860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.743138 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.743413 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.744029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.745987 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.838285 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1265/2548] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:29.842795 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:29.853447 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366d9da-5086-4a27-984f-7593c2ff8ede None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:29.908917 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:29.909532 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:29.909812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:29.910080 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:29.910691 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:29.912592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:29.991437 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1284/2549] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:29 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:29.996212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:30.006427 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b1934-94b8-41ed-98e1-fc3efdac5405 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:30.010984 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:30.011584 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.011849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.012117 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.012812 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:30.014461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:30.024913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1266/2550] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:30.028827 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:30.038897 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f013547-5d86-417e-9afa-dbed09b6a27a admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:30.044596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:30.045290 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.046559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.046559 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] PATH_INFO: `/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e/users/540d52a8019e415a8df72c19c0404c81/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.061365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbd71312ee34e2dbccdb51a30aec98e, user_id=540d52a8019e415a8df72c19c0404c81, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:30.064066 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:30.128792 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1285/2551] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:30 2022] PUT /identity/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e/users/540d52a8019e415a8df72c19c0404c81/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:30.132933 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:30.143454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddfdda-809a-4e41-b7a4-adf08f001164 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:30.163761 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:30.199084 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:30.199693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.199975 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.200251 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.200913 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:30.202559 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e48fa-7fc7-4aea-819d-b8c69cf6e2fe admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:30.212836 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1267/2552] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:30.217831 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:30.223427 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:30.228848 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad471f-833e-458f-bc8d-0a64f33995fa admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:30.233653 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:30.234302 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.234581 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.234855 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] PATH_INFO: `/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e/users/540d52a8019e415a8df72c19c0404c81/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.236859 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbbd71312ee34e2dbccdb51a30aec98e, user_id=540d52a8019e415a8df72c19c0404c81, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:30.239684 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:30.250468 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1286/2553] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:30 2022] PUT /identity/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e/users/540d52a8019e415a8df72c19c0404c81/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:30.260525 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.260813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.261693 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.289053 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] MFA Rules not processed for user `540d52a8019e415a8df72c19c0404c81`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:30.290331 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:30.359653 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1268/2554] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 12 12:52:30.370967 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:30.372674 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:30.431497 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc6673-a110-4d51-982a-8e0f32ca9373 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:30.435178 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:30.435771 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:30.436053 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:30.436324 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:30.445235 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:30.446664 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc10b03-59a3-49c9-89a4-23468f872982 service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:30.456017 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1287/2555] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:31.456809 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:31.518191 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdebb462-c994-42c0-9629-40b9b1d7f590 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:31.522894 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:31.523518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:31.523822 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:31.524092 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] PATH_INFO: `/v3/users/ae779351db274aac8bd3c50283bb3a9b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:31.525244 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae779351db274aac8bd3c50283bb3a9b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:31.527197 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:31.743158 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae779351db274aac8bd3c50283bb3a9b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:31.744264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:31.750573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae779351db274aac8bd3c50283bb3a9b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:31.751270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae779351db274aac8bd3c50283bb3a9b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:31.825277 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae779351db274aac8bd3c50283bb3a9b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:31.837396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae779351db274aac8bd3c50283bb3a9b'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:31.843871 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1269/2556] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:31 2022] DELETE /identity/v3/users/ae779351db274aac8bd3c50283bb3a9b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:31.848418 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:31.848899 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:31.848999 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:31.868165 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:31.869400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:31.927656 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1288/2557] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:31.937289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:31.938687 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:31.994631 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e691e9-bfe9-4310-a4dc-076603a57796 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:31.998168 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:31.998766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:31.999040 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:31.999312 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:32.008033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:32.009487 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:32.018719 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1270/2558] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:32.387754 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:32.389491 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:32.402270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ef00-084f-4296-bd1c-5548e43f90b5 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:32.406978 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:32.407605 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:32.407889 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:32.408164 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] PATH_INFO: `/v3/projects/6a0281dd82bb4c91a54474054573d961` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:32.409332 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a0281dd82bb4c91a54474054573d961)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:32.411240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:32.511920 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a0281dd82bb4c91a54474054573d961', 'request_id': 'req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.518140 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a0281dd82bb4c91a54474054573d961', 'request_id': 'req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.614610 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a0281dd82bb4c91a54474054573d961', 'request_id': 'req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.626123 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] The token cache is being invalidate because project 6a0281dd82bb4c91a54474054573d961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:32.626411 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.627037 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.628530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1289/2559] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:32 2022] DELETE /identity/v3/projects/6a0281dd82bb4c91a54474054573d961 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:32.632517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:32.642150 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ff96-56d2-43e0-854e-9c96f852387d service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:32.698215 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:32.698896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:32.699177 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:32.699454 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] PATH_INFO: `/v3/users/540d52a8019e415a8df72c19c0404c81` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:32.700572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540d52a8019e415a8df72c19c0404c81)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:32.702529 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:32.874239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540d52a8019e415a8df72c19c0404c81'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.881116 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540d52a8019e415a8df72c19c0404c81'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.881834 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540d52a8019e415a8df72c19c0404c81'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.951046 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540d52a8019e415a8df72c19c0404c81'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.956350 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:32.963344 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-053a23e3-fba2-4e4b-bd55-6fcdd2efaf38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540d52a8019e415a8df72c19c0404c81'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:32.969962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1271/2560] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:32 2022] DELETE /identity/v3/users/540d52a8019e415a8df72c19c0404c81 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:33.352091 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:33.353694 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:33.367915 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb152f5-9f9c-4178-9ecb-f9915f6f321b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:33.381804 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:33.426736 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:33.427365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:33.427645 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:33.427914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] PATH_INFO: `/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:33.429102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbbd71312ee34e2dbccdb51a30aec98e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:33.431031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:33.557081 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbbd71312ee34e2dbccdb51a30aec98e', 'request_id': 'req-2b06544a-be24-475e-b739-dd19b4a9e557'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:33.565148 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbbd71312ee34e2dbccdb51a30aec98e', 'request_id': 'req-2b06544a-be24-475e-b739-dd19b4a9e557'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:33.659777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbbd71312ee34e2dbccdb51a30aec98e', 'request_id': 'req-2b06544a-be24-475e-b739-dd19b4a9e557'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:33.670938 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] The token cache is being invalidate because project bbbd71312ee34e2dbccdb51a30aec98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:33.671231 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:33.674641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-2b06544a-be24-475e-b739-dd19b4a9e557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:33.674641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1290/2561] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:33 2022] DELETE /identity/v3/projects/bbbd71312ee34e2dbccdb51a30aec98e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:33.679450 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:33.679918 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:33.680018 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:33.700656 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:33.707545 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:33.762028 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1272/2562] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:33.823994 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:33.824288 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:33.824575 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:33.844107 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:33.845338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:33.852979 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1291/2563] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:33.857054 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:33.866896 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0eb97-3324-48ba-b0b2-f5486741b48f None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:33.871964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:33.872589 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:33.872900 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:33.873211 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] PATH_INFO: `/v3/domains` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:33.873859 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81526) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:52:33.874165 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:33.875788 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:33.887806 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1273/2564] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 12 12:52:33.891885 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:33.900990 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fbd647-9862-43ed-93a6-7df81100af4a None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:33.905639 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:33.906221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:33.906498 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:33.906766 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:33.907392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:33.909285 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.003253 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1292/2565] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:33 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:52:34.007240 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.017848 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80755fef-d379-4276-9431-c486ec807469 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.075574 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.076174 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.076468 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.076723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.077436 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.079345 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.161835 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1274/2566] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:34 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:52:34.166020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.176818 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0840c3-d2e7-4e73-9939-7a6ab07a2c60 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.181480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.182693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.182693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.182693 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.183325 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.184987 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.194858 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1293/2567] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:34.199113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.209404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd153d5-8707-4fbe-9f6b-758a371115d3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.214868 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.215456 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.215735 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.216007 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.216644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.218247 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb582-af54-4938-976d-f4f373c84e3b admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.228691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1275/2568] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:34.232839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.242864 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0aa23b-ef7f-4d20-956e-739d9aaa5928 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.247537 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.248181 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.248480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.248752 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] PATH_INFO: `/v3/projects/da0767ffcb264a8f8d0c1b4760f1309b/users/e8ac8d8f27914501958b03cad56f7a3e/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.263814 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da0767ffcb264a8f8d0c1b4760f1309b, user_id=e8ac8d8f27914501958b03cad56f7a3e, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.266481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.339849 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1294/2569] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:34 2022] PUT /identity/v3/projects/da0767ffcb264a8f8d0c1b4760f1309b/users/e8ac8d8f27914501958b03cad56f7a3e/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:34.349623 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.350010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.350290 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.378273 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] MFA Rules not processed for user `e8ac8d8f27914501958b03cad56f7a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:34.379535 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:34.421049 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:34.443694 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1276/2570] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:34.448237 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.492663 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:34.509747 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061abcd3-508d-4853-b544-ed76ae876dc4 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.515051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.515597 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.515868 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.516143 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.516805 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.518725 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.602912 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1295/2571] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:34 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:34.606718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.617829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23c423-3e6e-4dfe-8c4b-29e2d4e45e57 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.674366 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.674971 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.675243 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.675514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.676146 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.678075 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.774056 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1277/2572] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:34 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 12 12:52:34.777746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.788166 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471823f-ad78-408a-9738-34e9f3c4e7dd admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.793439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.794294 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.794578 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.796025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.796025 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.797064 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.807034 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1296/2573] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 12 12:52:34.811461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.821336 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bedb031-5aef-4cbb-a593-53dad4b20161 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.825958 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.826550 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.826829 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.827101 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.827740 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.829362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28eba0-ae33-4df0-8b0a-638efc5a8703 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.839100 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1278/2574] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:34.843168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:34.853052 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751c26b-ac86-4c70-a0e2-3425437f2520 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:34.858258 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:34.858902 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.859194 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.859471 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] PATH_INFO: `/v3/projects/5537e9ceae5b481288b63926239bd7fa/users/f63a164eee1949efa3b9a51b4c51fe2b/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.875523 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5537e9ceae5b481288b63926239bd7fa, user_id=f63a164eee1949efa3b9a51b4c51fe2b, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:34.878208 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:34.950798 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1297/2575] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:34 2022] PUT /identity/v3/projects/5537e9ceae5b481288b63926239bd7fa/users/f63a164eee1949efa3b9a51b4c51fe2b/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:34.962187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:34.962474 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:34.962749 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:34.990976 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] MFA Rules not processed for user `f63a164eee1949efa3b9a51b4c51fe2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:34.992187 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:35.056260 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1279/2576] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:35.060886 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.122960 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2213c5c-0e09-45b8-9e0c-ca6a6791d6e7 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.127666 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.128262 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.128542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.128812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.129484 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.131439 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.238079 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1298/2577] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:35 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:35.242112 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.253532 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8927b4-eec4-4a06-b580-47012c1fcee7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.300159 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:35.310203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.310813 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.311094 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.311394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.312082 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.314068 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.396139 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1280/2578] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:35 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:35.400167 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.410314 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013af425-ad58-4af1-bec4-10c57b384d23 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.415249 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.415839 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.416118 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.416388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.417102 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.418992 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.429372 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1299/2579] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:35.433853 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.443561 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8827eb-e2e9-4859-88ba-006ee0140df3 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.448113 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.449422 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.449724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.449994 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] PATH_INFO: `/v3/projects/d97f84ef382b4ce081b41b91ba01a311/users/fc4abc45fa2f4439a0d81c44828fd6c1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.464382 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97f84ef382b4ce081b41b91ba01a311, user_id=fc4abc45fa2f4439a0d81c44828fd6c1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.467077 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.532378 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1281/2580] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:35 2022] PUT /identity/v3/projects/d97f84ef382b4ce081b41b91ba01a311/users/fc4abc45fa2f4439a0d81c44828fd6c1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:52:35.536200 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.547138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defc58d-63db-4f42-adcb-cf38090c6d05 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.607215 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.608032 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.608174 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.608364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.608998 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.610629 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd154c0-57e1-4b7e-b18d-2943115c5c35 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.620047 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1300/2581] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:35.624942 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.635134 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd585-78ec-4cd2-845f-abb69a485b60 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.640218 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.640870 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.641172 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.641449 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] PATH_INFO: `/v3/projects/d97f84ef382b4ce081b41b91ba01a311/users/fc4abc45fa2f4439a0d81c44828fd6c1/roles/66e345ff9b6440f2bda44a6d1bb98077` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.643359 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97f84ef382b4ce081b41b91ba01a311, user_id=fc4abc45fa2f4439a0d81c44828fd6c1, role_id=66e345ff9b6440f2bda44a6d1bb98077)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.646023 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.656759 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1282/2582] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:35 2022] PUT /identity/v3/projects/d97f84ef382b4ce081b41b91ba01a311/users/fc4abc45fa2f4439a0d81c44828fd6c1/roles/66e345ff9b6440f2bda44a6d1bb98077 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:35.666768 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.667058 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.667336 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.674737 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:35.695326 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] MFA Rules not processed for user `fc4abc45fa2f4439a0d81c44828fd6c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:35.696542 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:35.764455 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1301/2583] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:35.775908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:35.778354 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:35.835373 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf4bda7-6dab-4dba-aeee-488859153018 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:35.839691 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:35.840287 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:35.840569 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:35.840846 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:35.896107 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:35.897516 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:35.906321 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1283/2584] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:37.881283 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:37.882726 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:37.894884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d80a06-bb47-4949-9018-9e6e6914999e None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:37.898565 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:37.899138 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:37.899424 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:37.899699 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:37.956480 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:37.958020 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:37.967443 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1302/2585] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:39.335424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:39.344654 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675e6dd-b7bc-4421-aa99-8bd61e95a5e9 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:39.348289 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:39.348886 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:39.349200 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:39.349476 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:39.359079 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:39.360513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d72f6-d4d4-476a-a4ee-20e5917549b0 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:39.370786 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1284/2586] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:43.996224 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:44.058192 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fff2f-bdc9-426f-9e75-38b59dd830eb service cinder] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:44.063240 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:44.063862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:44.064142 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:44.064415 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] PATH_INFO: `/v3/users/e8ac8d8f27914501958b03cad56f7a3e` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:44.065576 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8ac8d8f27914501958b03cad56f7a3e)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:44.067481 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:44.158293 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:44.284470 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8ac8d8f27914501958b03cad56f7a3e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:44.291587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8ac8d8f27914501958b03cad56f7a3e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:44.304026 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8ac8d8f27914501958b03cad56f7a3e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:44.304714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8ac8d8f27914501958b03cad56f7a3e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:44.374062 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8ac8d8f27914501958b03cad56f7a3e'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:44.380359 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1303/2587] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:43 2022] DELETE /identity/v3/users/e8ac8d8f27914501958b03cad56f7a3e => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:44.384881 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:44.385394 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:44.385500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:44.404858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:44.406080 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:44.445421 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:44.463514 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1285/2588] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:44.473950 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:44.475361 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:44.532357 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764de0-4889-4a22-9e42-c70b0382eec8 admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:44.536048 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:44.536592 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:44.536874 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:44.537168 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:44.546862 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:44.548281 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:44.557706 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1304/2589] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:44.981708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:44.983153 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:44.995186 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16779c3b-1a96-4add-afed-ba5cd464a6b7 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:45.000893 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:45.001817 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:45.002106 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:45.002390 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] PATH_INFO: `/v3/projects/da0767ffcb264a8f8d0c1b4760f1309b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:45.004465 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] RBAC: Authorizing `identity:delete_project(project_id=da0767ffcb264a8f8d0c1b4760f1309b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:45.006518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:45.099635 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da0767ffcb264a8f8d0c1b4760f1309b', 'request_id': 'req-c7a5c141-73aa-4b31-9358-cdc3facd657f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.105114 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da0767ffcb264a8f8d0c1b4760f1309b', 'request_id': 'req-c7a5c141-73aa-4b31-9358-cdc3facd657f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.111858 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da0767ffcb264a8f8d0c1b4760f1309b', 'request_id': 'req-c7a5c141-73aa-4b31-9358-cdc3facd657f'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.167391 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] The token cache is being invalidate because project da0767ffcb264a8f8d0c1b4760f1309b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:45.167708 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.168887 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.170381 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1286/2590] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:44 2022] DELETE /identity/v3/projects/da0767ffcb264a8f8d0c1b4760f1309b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:45.174392 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:45.184981 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888889b2-0122-461a-a32d-c0758e2b5c33 service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:45.241464 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:45.242082 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:45.242364 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:45.242637 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] PATH_INFO: `/v3/users/f63a164eee1949efa3b9a51b4c51fe2b` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:45.243777 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f63a164eee1949efa3b9a51b4c51fe2b)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:45.245744 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:45.466739 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f63a164eee1949efa3b9a51b4c51fe2b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.468683 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:45.474586 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f63a164eee1949efa3b9a51b4c51fe2b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.486750 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f63a164eee1949efa3b9a51b4c51fe2b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.487429 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f63a164eee1949efa3b9a51b4c51fe2b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.550440 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f63a164eee1949efa3b9a51b4c51fe2b'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:45.556808 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1305/2591] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:45 2022] DELETE /identity/v3/users/f63a164eee1949efa3b9a51b4c51fe2b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:45.946581 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:45.950531 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:45.962374 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5c141-73aa-4b31-9358-cdc3facd657f admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:46.025810 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:46.026490 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:46.026774 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:46.027050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] PATH_INFO: `/v3/projects/5537e9ceae5b481288b63926239bd7fa` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:46.028214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5537e9ceae5b481288b63926239bd7fa)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:46.030305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:46.128876 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5537e9ceae5b481288b63926239bd7fa', 'request_id': 'req-208d121b-1ce4-4648-b417-af492ac5b9db'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.134791 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5537e9ceae5b481288b63926239bd7fa', 'request_id': 'req-208d121b-1ce4-4648-b417-af492ac5b9db'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.141917 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5537e9ceae5b481288b63926239bd7fa', 'request_id': 'req-208d121b-1ce4-4648-b417-af492ac5b9db'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.219334 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:46.224050 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] The token cache is being invalidate because project 5537e9ceae5b481288b63926239bd7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:46.224282 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.224964 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.226518 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1287/2592] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:45 2022] DELETE /identity/v3/projects/5537e9ceae5b481288b63926239bd7fa => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:46.230599 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:46.232043 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:46.244631 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d57f0a-10ca-47bf-ad58-44dd1fbe26bf admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:46.302419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:46.303051 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:46.303338 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:46.303619 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] PATH_INFO: `/v3/users/fc4abc45fa2f4439a0d81c44828fd6c1` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:46.304746 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4abc45fa2f4439a0d81c44828fd6c1)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:46.306714 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:46.501580 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4abc45fa2f4439a0d81c44828fd6c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.508696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4abc45fa2f4439a0d81c44828fd6c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.521289 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4abc45fa2f4439a0d81c44828fd6c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.521963 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4abc45fa2f4439a0d81c44828fd6c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.584973 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-6090e31b-485e-41a9-ae74-de09d2202515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4abc45fa2f4439a0d81c44828fd6c1'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:46.592041 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1306/2593] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:52:46 2022] DELETE /identity/v3/users/fc4abc45fa2f4439a0d81c44828fd6c1 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:46.991821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:46.994193 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:47.006980 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d121b-1ce4-4648-b417-af492ac5b9db admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.065695 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.066264 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.066548 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.066827 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] PATH_INFO: `/v3/projects/d97f84ef382b4ce081b41b91ba01a311` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.067960 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97f84ef382b4ce081b41b91ba01a311)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.069931 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.157583 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97f84ef382b4ce081b41b91ba01a311', 'request_id': 'req-cac20815-e485-46c0-a1ea-5e7e6a39f98c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:47.163161 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97f84ef382b4ce081b41b91ba01a311', 'request_id': 'req-cac20815-e485-46c0-a1ea-5e7e6a39f98c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:47.169728 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97f84ef382b4ce081b41b91ba01a311', 'request_id': 'req-cac20815-e485-46c0-a1ea-5e7e6a39f98c'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:47.251754 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] The token cache is being invalidate because project d97f84ef382b4ce081b41b91ba01a311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81526) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:52:47.252045 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:47.252701 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-cac20815-e485-46c0-a1ea-5e7e6a39f98c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:52:47.254220 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1288/2594] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:52:46 2022] DELETE /identity/v3/projects/d97f84ef382b4ce081b41b91ba01a311 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:52:47.259153 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.259618 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.259733 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.280401 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:47.281696 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:47.322046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:47.339430 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1307/2595] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:47.347628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.347909 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.348180 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.367573 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:47.368767 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:47.376579 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1289/2596] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:47.380636 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.391046 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac2934-58d6-4f43-b949-03d04dac31f4 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.395688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.396276 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.396553 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.396822 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] PATH_INFO: `/v3/domains` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.397499 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81527) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 12 12:52:47.397800 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.399416 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.411911 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1308/2597] 10.222.0.50 () {58 vars in 1153 bytes} [Wed Oct 12 12:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 12 12:52:47.416010 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.425481 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d6fac-a0e3-4496-9b8f-135b911386e9 None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.430127 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.430716 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.430997 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.431270 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] PATH_INFO: `/v3/projects` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.431908 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.433919 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.564406 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1290/2598] 10.222.0.50 () {60 vars in 1153 bytes} [Wed Oct 12 12:52:47 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:47.568516 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.582105 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d4e31-f304-4843-abb7-caaaef6f593b admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.638031 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.638635 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.638914 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.639183 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] PATH_INFO: `/v3/users` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.639812 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.641759 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.722475 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1309/2599] 10.222.0.50 () {60 vars in 1144 bytes} [Wed Oct 12 12:52:47 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 12 12:52:47.726572 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.737102 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653161-4763-41c7-b456-eefa4a654081 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.741879 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.742472 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.742753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.743026 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.743664 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.745367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.755615 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1291/2600] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:47.759546 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.770596 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a69a71-ad16-42a4-b55b-8940177fee3d admin admin] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.775649 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.778630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.778630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.778630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.778630 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.779287 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6d3c3-8221-4de7-a55b-a79b4ef83bb0 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.790012 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1310/2601] 10.222.0.50 () {58 vars in 1122 bytes} [Wed Oct 12 12:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 12 12:52:47.794448 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:47.804562 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b7acf-1cf7-47b6-8f97-6a8ea6e775e7 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:47.811400 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:47.813078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] REQUEST_METHOD: `PUT` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.813078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.813078 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] PATH_INFO: `/v3/projects/b5b10e1f90cd4c55aab03b0b67dbbf8a/users/eabb4b7f3361478b8fbfa86ab1188f84/roles/6fb6c940635c427694cb507fd7126d0b` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.827723 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b10e1f90cd4c55aab03b0b67dbbf8a, user_id=eabb4b7f3361478b8fbfa86ab1188f84, role_id=6fb6c940635c427694cb507fd7126d0b)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:47.830441 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:47.899169 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1292/2602] 10.222.0.50 () {60 vars in 1483 bytes} [Wed Oct 12 12:52:47 2022] PUT /identity/v3/projects/b5b10e1f90cd4c55aab03b0b67dbbf8a/users/eabb4b7f3361478b8fbfa86ab1188f84/roles/6fb6c940635c427694cb507fd7126d0b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 12 12:52:47.910538 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f2ea-72e3-4db7-82d6-0f4675f9f595 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:47.910832 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f2ea-72e3-4db7-82d6-0f4675f9f595 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:47.911137 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1f2ea-72e3-4db7-82d6-0f4675f9f595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:47.939668 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-e7d1f2ea-72e3-4db7-82d6-0f4675f9f595 None None] MFA Rules not processed for user `eabb4b7f3361478b8fbfa86ab1188f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:47.940884 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-e7d1f2ea-72e3-4db7-82d6-0f4675f9f595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:48.003544 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1311/2603] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:48.014110 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:48.015840 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:48.044718 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:48.074364 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13947384-6b41-4938-99e5-75b199107760 admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:48.078060 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a804dd78ed44695afad6616ac504d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:48.078661 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:48.078938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:48.079210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:48.087402 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:48.088916 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:48.098404 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1293/2604] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:49.900626 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:49.901095 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:49.901244 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:49.920036 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] MFA Rules not processed for user `eabb4b7f3361478b8fbfa86ab1188f84`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:52:49.921274 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:49.928044 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1312/2605] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:52:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:52:50.463272 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:50.465424 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:50.536821 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ebd53b-7f5d-4cbf-b533-e2e9942d6088 service cinder] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:50.541852 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:50.542457 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:50.542738 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:50.543009 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:50.545626 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:50.556930 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:50.558549 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:50.568392 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1294/2606] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:54.029717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:54.029717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:54.071113 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:54.091453 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3491afb-3077-46eb-96df-cd228cba49cf None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:54.095895 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:54.097355 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:54.097953 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:54.098236 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:54.101246 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:54.112211 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:54.113718 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:54.123536 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1313/2607] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:52:54.892461 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:52:54.894517 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:54.972659 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb251790-179a-44f1-bc51-8b45b36034a2 service placement] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:52:54.979239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:52:54.984707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:52:54.984707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:52:54.984707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:52:54.984707 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:52:54.996033 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:52:54.998196 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87d110-8d16-491d-8f5b-013a6338622d service nova] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:52:55.009257 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1295/2608] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:52:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:53:00.305697 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:00.319400 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9985b-a896-45c9-aaf9-9374ff163a5b service neutron] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:00.325688 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbb7f8775d5e4224a18fc0dd7a5f53b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:00.331704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:00.331704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:00.331704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:00.331704 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:00.340882 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:00.342486 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:00.353106 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1314/2609] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:53:05.004396 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=81 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:06.566938 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699483-923d-4669-80c1-376dab112e5e None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:06.567513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699483-923d-4669-80c1-376dab112e5e None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:06.567513 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f699483-923d-4669-80c1-376dab112e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:06.616609 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-3f699483-923d-4669-80c1-376dab112e5e None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:53:06.617849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-3f699483-923d-4669-80c1-376dab112e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:06.680940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1296/2610] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:53:06.817251 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:06.818670 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:06.907442 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fd2cf4-ff98-4845-b0ce-62a5cc59debd service nova] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:06.912458 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:06.913057 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:06.913365 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:06.913641 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:06.922419 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:06.924002 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:06.932040 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1315/2611] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:53:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:07.673571 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360139-98f8-4b1a-a2de-f03a09d675b9 None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:07.674051 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360139-98f8-4b1a-a2de-f03a09d675b9 None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:07.674154 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5360139-98f8-4b1a-a2de-f03a09d675b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:07.693651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-a5360139-98f8-4b1a-a2de-f03a09d675b9 None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:53:07.694861 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-a5360139-98f8-4b1a-a2de-f03a09d675b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:07.702644 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1297/2612] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:53:07.714585 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:07.725513 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee1f1-4be2-4e88-9617-b993c7d101cd service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:07.730654 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:07.731247 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:07.731530 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:07.731837 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:07.739867 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:07.741526 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:07.750312 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1316/2613] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:53:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:08.389679 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2bfa-098a-4e30-af73-73cda58aeeae None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:08.389962 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2bfa-098a-4e30-af73-73cda58aeeae None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:08.390239 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb2bfa-098a-4e30-af73-73cda58aeeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:08.409651 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-52bb2bfa-098a-4e30-af73-73cda58aeeae None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:53:08.410851 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-52bb2bfa-098a-4e30-af73-73cda58aeeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:08.418319 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1298/2614] 10.222.0.50 () {58 vars in 1009 bytes} [Wed Oct 12 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:53:08.430555 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:08.441073 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605a98d-5b3d-4c70-a003-f3504896ad3f service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:08.446363 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:08.446962 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:08.447245 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:08.447519 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:08.455713 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:08.457321 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:08.465221 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1317/2615] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:53:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:09.017645 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] REQUEST_METHOD: `POST` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:09.018109 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:09.018212 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:09.037940 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.auth.core [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] MFA Rules not processed for user `1ea7c1b7087545fabde10f0460530873`. Rule list: `[]` (Enabled: `True`). {{(pid=81526) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:53:09.039145 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:09.046760 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1299/2616] 10.222.0.50 () {58 vars in 967 bytes} [Wed Oct 12 12:53:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:53:09.059069 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:09.069929 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da600894-df88-45c1-aca1-59fa0c4ee957 service swift] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:09.075130 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc59606d2aa4ce7aa86f25d905b9e6d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:09.075717 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] REQUEST_METHOD: `GET` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:09.075997 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:09.076270 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:09.084799 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:09.086390 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8275bc41-eb2c-4f8b-b064-9121f13719a9 service swift] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:09.095161 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1318/2617] 10.222.0.50 () {60 vars in 1384 bytes} [Wed Oct 12 12:53:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:11.862389 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:11.923175 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4247f4e-c29f-4c14-b6de-d132c33e439b None None] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:11.927606 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:11.928221 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:11.928495 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:11.928766 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] PATH_INFO: `/v3/users/eabb4b7f3361478b8fbfa86ab1188f84` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:11.929904 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=eabb4b7f3361478b8fbfa86ab1188f84)` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:11.931808 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:12.096849 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eabb4b7f3361478b8fbfa86ab1188f84'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.102214 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:12.104210 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eabb4b7f3361478b8fbfa86ab1188f84'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.104882 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eabb4b7f3361478b8fbfa86ab1188f84'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.218772 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eabb4b7f3361478b8fbfa86ab1188f84'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.231362 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.notifications [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eabb4b7f3361478b8fbfa86ab1188f84'} {{(pid=81526) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.237409 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1300/2618] 10.222.0.50 () {58 vars in 1224 bytes} [Wed Oct 12 12:53:11 2022] DELETE /identity/v3/users/eabb4b7f3361478b8fbfa86ab1188f84 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:53:12.241888 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] REQUEST_METHOD: `POST` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:12.242388 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:12.242525 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:12.262813 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.auth.core [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] MFA Rules not processed for user `02af815b1eff42b89905491a18971077`. Rule list: `[]` (Enabled: `True`). {{(pid=81527) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 12 12:53:12.264613 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:12.311474 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=100 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:12.323007 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1319/2619] 10.222.0.50 () {58 vars in 958 bytes} [Wed Oct 12 12:53:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 12 12:53:12.333367 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:12.334845 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:12.393207 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317155ff-fc72-4ccd-ad59-75c11fec16ed admin admin] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:12.396860 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2757d3bd0a47405bbf3ea97ecb3cf93a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:12.397660 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:12.398029 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:12.398302 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:12.407305 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:12.408724 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:12.418238 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1301/2620] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:53:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:53:12.655930 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] Authenticating user token {{(pid=81527) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:53:12.657560 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.fernet_utils [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81527) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:53:12.669767 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b453a19-228b-4920-a68d-a113f21c9744 None None] Validating token access rules against request {{(pid=81527) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:53:12.674574 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02af815b1eff42b89905491a18971077', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf6bda1a6094b07a02029e1fb53aa49', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81527) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:53:12.676587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:53:12.676587 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:53:12.676873 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] PATH_INFO: `/v3/projects/b5b10e1f90cd4c55aab03b0b67dbbf8a` {{(pid=81527) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:53:12.678054 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b10e1f90cd4c55aab03b0b67dbbf8a)` {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:53:12.679944 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] RBAC: Authorization granted {{(pid=81527) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:53:12.800823 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b10e1f90cd4c55aab03b0b67dbbf8a', 'request_id': 'req-94ee457c-5b7b-475a-9aa3-752ce336d2b7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.807169 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b10e1f90cd4c55aab03b0b67dbbf8a', 'request_id': 'req-94ee457c-5b7b-475a-9aa3-752ce336d2b7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.875876 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b10e1f90cd4c55aab03b0b67dbbf8a', 'request_id': 'req-94ee457c-5b7b-475a-9aa3-752ce336d2b7'} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.886162 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] The token cache is being invalidate because project b5b10e1f90cd4c55aab03b0b67dbbf8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81527) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 12 12:53:12.886451 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.887072 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG keystone.notifications [None req-94ee457c-5b7b-475a-9aa3-752ce336d2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81527) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 12 12:53:12.888545 dv-cinder-846146-8-smb devstack@keystone.service[81527]: [pid: 81527|app: 0|req: 1320/2621] 10.222.0.50 () {58 vars in 1233 bytes} [Wed Oct 12 12:53:12 2022] DELETE /identity/v3/projects/b5b10e1f90cd4c55aab03b0b67dbbf8a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 12 12:53:22.413862 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=35,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:22.883191 dv-cinder-846146-8-smb devstack@keystone.service[81527]: DEBUG dbcounter [-] [81527] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81527) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:54:23.759717 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] Authenticating user token {{(pid=81526) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 12 12:54:23.762935 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:54:23.830628 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f9abae-f71c-417e-999c-50a31adc544b service neutron] Validating token access rules against request {{(pid=81526) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 12 12:54:23.889044 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b97ffadf3cd944069d1822826ac35e4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '396c3dd232544e709cb8876c985f934c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81526) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 12 12:54:23.890203 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] REQUEST_METHOD: `GET` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 12 12:54:23.890480 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] SCRIPT_NAME: `/identity` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 12 12:54:23.890753 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81526) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 12 12:54:23.892500 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.fernet_utils [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81526) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 12 12:54:23.903720 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 12 12:54:23.906826 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a18a9-9029-436b-9551-41bbdd6d850f service placement] RBAC: Authorization granted {{(pid=81526) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 12 12:54:23.917705 dv-cinder-846146-8-smb devstack@keystone.service[81526]: [pid: 81526|app: 0|req: 1302/2622] 10.222.0.50 () {60 vars in 1365 bytes} [Wed Oct 12 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 12 12:54:33.913011 dv-cinder-846146-8-smb devstack@keystone.service[81526]: DEBUG dbcounter [-] [81526] Writing DB stats keystone:SELECT=58 {{(pid=81526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}